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Abstract. In this article, we study the large time behavior of solutions 
of first-order Hamilton- Jacobi Equations, set in a bounded domain with 
nonlinear Neumann boundary conditions, including the case of dynamical 
boundary conditions. We establish general convergence results for viscosity 
solutions of these Cauchy- Neumann problems by using two fairly different 
methods : the first one relics only on partial differential equations methods, 
which provides results even when the Hamiltonians are not convex, and the 
second one is an optimal control/dynamical system approach, named the 
"weak KAM approach" which requires the convexity of Hamiltonians and 
gives formulas for asymptotic solutions based on Aubry-Mather sets. 
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Introduction 

We are interested in this article in the large time behavior of solutions of 
first-order Hamilton- Jacobi Equations, set in a bounded domain with nonlin- 
ear Neumann boundary conditions, including the case of dynamical boundary 
conditions. The main originality of this paper is twofold : on one hand, we 
obtain results for these nonlinear Neumann type problems in their full gen- 
erality, with minimal assumptions (at least we think so) and, on the other 
hand, we provide two types of proofs following the two classical approaches for 
these asymptotic problems : the first one by the PDE methods which has the 
advantages of allowing to treat cases when the Hamiltonians are non-convex, 
the second one by an optimal control/dynamical system approach which gives 
a little bit more precise description of the involved phenomena. For Cauchy- 
Neumann problems with linear Neumann boundary conditions, the asymptotic 
behavior has been established very recently and independently by the second 
author in [23] by using the dynamical approach and the first and third authors 
in [5] by using the PDE approach. 

In order to be more specific, we introduce the following initial-boundary 
value problems 

in Q x (0, oo), 
on dQ x (0, oo), 
on n 

in Q x (0, oo), 
on dQ x (0, oo), 
on Q, 

where Q is a bounded domain of M n with a C 1 -boundary and u is a real- valued 
unknown function on Q x [0,oo). We, respectively, denote by u t := du/dt 
and Du := (du/dxi, . . . , du/dx n ) its time derivative and gradient with respect 
to the space variable. The functions H(x,p), B(x,p) are given real- valued 
continuous function on Q x M n ; more precise assumptions on H and B will be 
given at the beginning of Section 1. 

Throughout this article, we are going to treat these problems by using the 
theory of viscosity solutions and thus the term "viscosity" will be omitted 
henceforth. We also point out that the boundary conditions have to be un- 
derstood in the viscosity sense: we refer the reader to the "User's guide to 
viscosity solutions" [9] for a precise definition which is not recalled here. 

The existence and uniqueness of solutions of (CN) or (DBC) are already 
well known. We refer to the articles [1, 2, 3, 20] and the references therein. 

The standard asymptotic behavior, as t — > +oo, for solutions of Hamilton- 
Jacobi Equations is the following : the solution u(x,t) is expected to look 
like — ct + v (x) where the constant c and the function v are solutions of an 
additive eigenvalue or ergodic problem. In our case, we have two different 



(CN) 



and 



(DBC) 



u t + H(x, Du) 
B(x,Du) = 
u(x, 0) = u (x) 



u t + H(x,Du) = 
u t + B(x,Du) = 

m(x, 0) = Uq(x) 
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ergodic problems for (CN) and (DBC): indeed, looking for a solution of the 
form —at + w(x) for (CN), where a is constant and w a function defined on Q, 
leads to the equation 



(El) 



H(x,Dw(x)) = a in Q, 

B(x,Dw(x))=0 ondtt 

while, for (DBC), the function w has to satisfy 

H(x, Dw(x)) = a in Q, 



(E2) 



B(x,Dw(x)) = a on dfl. 



We point out that one seeks, here, for a pair (w, a) where w G C(Q) and a G M 
such that w is a solution of (El) or (E2). If (w, a) is such a pair, we call w 
an additive eigenfunction or ergodic function and a an additive eigenvalue or 
ergodic constant. 

A typical result, which was first proved for Hamilton- Jacobi Equations set in 
MJ 1 in the periodic case by P.-L. Lions, G. Papanicolaou and S. R. S. Varadhan 
[26], is that there exists a unique constant a = c for which this problem has a 
bounded solution, while the associated solution w may not be unique, even up 
to an additive constant. This non- uniqueness feature is a key difficulty in the 
study of the asymptotic behavior. 

The main results of this article are the following : under suitable (and rather 
general) assumptions on H and B 

(i) There exists a unique constant c such that (El) (resp., (E2)) has a solution 
in C(H). 

(ii) If u is a solution of (CN) (resp., (DBC)), then there exists a solution 
(v,c) G C(H) x R of (El) (resp., (E2)), such that 

u(x,t) — (v(x) — ct) — > uniformly on f2 as t — > oo. (0.1) 

The rest of this paper consists in making these claims more precise by pro- 
viding the correct assumptions on H and B, by recalling the main existence 
and uniqueness results on (CN) and (DBC), by solving (El) and (E2), and 
proving (i) and finally by showing the asymptotic result (ii). In an attempt 
to make the paper concise, we have decided to present the full proof of (ii) 
for (CN) only by the optimal control/dynamical system approach while we 
prove the (DBC) result only by the PDE approach. To our point of view, 
these proofs are the most relevant one, the two other proofs following along 
the same lines and being even simpler. 

In the last decade, the large time behavior of solutions of Hamilton- Jacobi 
equation in compact manifold M. (or in MJ 1 , mainly in the periodic case) has 
received much attention and general convergence results for solutions have 
been established. G. Namah and J.-M. Roquejoffre in [30] are the first to 
prove (0.1) under the following additional assumption 

H(x,p) > H(x,0) for all (x,p) G M x M. n and maxH(x,0) = 0, (0.2) 

M 
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where M. is a smooth compact n- dimensional manifold without boundary. 
Then A. Fathi in [12] proved the same type of convergence result by dynamical 
systems type arguments introducing the "weak KAM theory". Contrarily to 
[30], the results of [12] use strict convexity (and smoothness) assumptions on 
H(x, •), i.e., D pp H(x,p) > al for all (x,p) 6Mxl" and a > (and also far 
more regularity) but do not require (0.2). Afterwards J.-M. Roquejoffre [31] 
and A. Davini and A. Siconolfi in [11] refined the approach of A. Fathi and 
they studied the asymptotic problem for Hamilton-Jacobi Equations on Ai or 
n-dimensional torus. The second author, Y. Fujita, N. Ichihara and P. Loreti 
have investigated the asymptotic problem specially in the whole domain IR n 
without the periodic assumptions in various situations by using the dynamical 
approach which is inspired by the weak KAM theory. See [13, 21, 16, 17, 18]. 
The first author and P. E. Souganidis obtained in [7] more general results, 
for possibly non-convex Hamiltonians, by using an approach based on partial 
differential equations methods and viscosity solutions, which was not using in 
a crucial way the explicit formulas of representation of the solutions. Later, 
by using partially the ideas of [7] but also of [30], results on the asymptotic 
problem for unbounded solutions were provided in [6]. 

There also exists results on the asymptotic behavior of solutions of con- 
vex Hamilton-Jacobi Equation with boundary conditions. The third author 
[27] studied the case of the state constraint boundary condition and then the 
Dirichlet boundary conditions [28, 29]. J.-M. Roquejoffre in [31] was also deal- 
ing with solutions of the Cauchy-Dirichlet problem which satisfy the Dirichlet 
boundary condition pointwise (in the classical sense) : this is a key difference 
with the results of [28, 29] where the solutions were satisfying the Dirichlet 
boundary condition in a generalized (viscosity solutions) sense. These results 
were slightly extended in [5] by using an extension of PDE approach of [7]. 

We also refer to the articles [31, 8] for the large time behavior of solutions to 
time- dependent Hamilton-Jacobi equations. Recently E. Yokoyama, Y. Giga 
and P. Rybka in [32] and the third author with Y. Giga and Q. Liu in [14, 15] 
has gotten the large time behavior of solutions of Hamilton-Jacobi equations 
with noncoercive Hamiltonian which is motivated by a model describing grow- 
ing faceted crystals. We refer to the article [10] for the large-time asymptotics 
of solutions of nonlinear Neumann-type problems for viscous Hamilton-Jacobi 
equations. 

This paper is organized as follows: in Section 1 we state the precise assump- 
tions on H and B, as well as some preliminary results on (CN), (DBC), (El) 
and (E2). Section 2 is devoted to the proof of convergence results (0.1) by 
the PDE approach. In Section 3 we devote ourselves to the proof of conver- 
gence results (0.1) by the optimal control/dynamical system approach. Then 
we need to give the variational formulas for solutions of (CN) and (DBC) and 
results which are related to the weak KAM theory, which are new and inter- 
esting themselves. In Appendix we give the technical lemma which is used in 
Section 2 and the proofs of basic results which are presented in Section 1. 
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Before closing the introduction, we give a few comments about our nota- 
tion. We write B r (x) = {y G M. n : \x — y\ < r} for x G R n , r > and 
B r := B r (0). For A C R l ,B C M m for /, m G N we denote by C(A,B), 
LSC (A, 5), USC (A, B), Lip (A, B) the space of real- valued continuous, lower 
semicontinuous, upper semicontinuous, Lipschitz continuous and on A with 
values in B, respectively. For p G M we denote by L P (A, B) and L°°(A, B) the 
set of all measurable functions whose absolute value raised to the p-th power 
has finite integral and which are bounded almost everywhere on A with values 
in B, respectively. We write C k (A) for the sets of fc-th continuous differen- 
tiable functions for fceE For given — oo < a < b < oo and x,y G B, we use 
the symbol AC([a,b],B) to denote the set of absolutely continuous functions 
on [a, b] with values in B. We call a function m : [0, oo) — > [0, oo) a modulus 
if it is continuous and nondecreasing on [0, oo) and vanishes at the origin. 



In this section, we introduce the key assumptions on H, B and we present 
basic PDE results on (CN) and (DBC) (existence, comparison,..., etc.) which 
will be used throughout this article. The proofs are given in the appendix. 

We use the following assumptions. 

(AO) Q is a bounded domain of M. n with a C 1 -boundary. 

In the sequel, we denote by p : MJ 1 — > R n a C 1 -defining function for Q, i.e. 
a C 1 -function which is negative in Q, positive in the complementary of fl 
and which satisfies Dp(x) ^ on dQ. Such a function exists because of the 
regularity of fL If x G dQ, we have Dp(x)/\Dp(x)\ = n(x) where n(x) is the 
unit outward normal vector to dQ at x. In order to simplify the presentation 
and notations, we will use below the notation n(x) for Dp(x), even if x is not 
on dQ. Of course, if x G dfl, n(x) is still an outward normal vector to dfl 
at x, by assumption h(x) does not vanish on dQ but it is not anymore a unit 
vector. 

(Al) The function H is continuous and coercive, i.e., 



1. Preliminaries and Main Result 



lim mf{H(x,p) : x G f2, \p\ > r} = oo. 



(A2) 



For any R > 0, there exists a constant Mr > such that 
\H(x,p) - H(x,q)\ < M R \p - q\ 



(A3) 



for all x G f2 and p, q G B R . 
There exists 9 > such that 



B(x, p + Xn(x)) — B(x, p) > 9\ 



(A4) 



for all x G dfl, p G R n and A G R with A > 0. 
There exists a constant Mb > such that 



\B(x,p)-B(x,q)\ < M B \p-q 
for any x G dQ and p,q G W 1 . 
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(A5) The function p h y B(x,p) is convex for any x G dQ. 

We briefly comment these assumptions. Assumption (Al) is classical when 
considering the large time behavior of solutions of Hamilton- Jacobi Equations 
since it is crucial to solve ergodic problems. Assumption (A2) is a non- 
restrictive technical assumption while (A3)-(A4) are (almost) the definition 
of a nonlinear Neumann boundary condition. Finally the convexity assump- 
tion (A5) on B will be necessary to obtain the convergence result. We point 
out that the requirements on the dependence of H and B in x are rather weak : 
this is a consequence of the fact that, because of (Al), we will deal (essentially) 
with Lipschitz continuous solutions (up to a regularization of the subsolution 
by sup-convolution in time. Therefore the assumptions are weaker than in the 
classical results (cf. [1, 2, 3, 20]). 

A typical example for B is the boundary condition arising in the optimal 
control of processes with reflection which has control parameters: 

B(x,p) = sup{7 Q (x) -p-gjx)}, 

where A is a compact metric space, g a : dQ — > R are given continuous functions 
and 7 a : Q — > R n is a continuous vector field which is oblique to dQ, i.e., 

n(x) ■ 7 Q (x) > 9 

for any x G dQ and a £ A. 

Our first result is a comparison result. 

Theorem 1.1 (Comparison Theorem for (CN) and (DBC)). Let u G USC (Ox 

[0, oo)) and v G LSC (Q x [0, oo)) be a subsolution and a supersolution of (CN) 
(resp., (DBC)), respectively. Ifu(-,0) <v(-,0) onQ, thenu<v on Qx[0, oo) . 

Then, applying carefully Perron's method (cf. [19]), we have the existence 
of Lipschitz continuous solutions. 

Theorem 1.2 (Existence and Regularity of Solutions of (CN) and (DBC)). 
For any uq G C(Q), there exists a unique solution u G UC (Q x [0, oo)) of 
(CN) or (DBC). Moreover, if uq G W l '°°(Q), then u is Lipschitz continuous 
on Q x [0, oo) and therefore u t and Du are uniformly bounded. Finally, if u 
and v are the solutions which are respectively associated to u and v , then 

\\u — f||z,°°(nx(0,oo)) < H u o — fo||L°°(fi) • (1-1) 
Finally we consider the additive eigenvalue/ergodic problems. 

Theorem 1.3 (Existence of Solutions of (El) and (E2)). There exists a so- 
lution (v,c) G W 1,oc (Q) x R of (El) (resp., (E2)). Moreover, the additive 
eigenvalue is unique and is represented by 

c = inf{a G R : (El) (resp., (E2)) has a subsolution}. (1-2) 

The following proposition shows that, taking into account the ergodic effect, 
we obtain bounded solutions of (CN) or (DBC). This result is a straightforward 
consequence of Theorems 1.3 and 1.1. 
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Proposition 1.4 (Boundedness of Solutions of (CN) and (DBC)). Let c be 

the additive eigenvalue for (El) (resp., (E2)). Let u be the solution of (CN) 
(resp., (DBC)). Then u + ct is bounded on Q x [0, oo). 

From now on, replacing u(x, t) by u(x, t) + ct, we can normalize the additive 
eigenvalue c to be 0. As a consequence H is also replaced by H — c and B by 
B — c in the (DBC)-case. In order to obtain the convergence result, we use the 
following assumptions. 

(A6) Either of the following assumption (A6)+ or (A6)_ holds. 
(A6)+ There exists r] > such that, for any rj G (0, rjo], there exists xjj v > 
such that if H(x,p + q) > r\ and H(x,q) < for some x G Q and 
p, q G M n , then for any /i G (0, 1], 
p 

fiH(x, - + q)> H(x,p + q) + ^(1 - /i). 

(A6)_ There exists r] > such that, for any r] G (0, 770] , there exists ip rj > 
such that if H(x,p + q) < —r) and H(x,q) < for some x G fi and 
p, g G M", then for any /x > 1, 

nH(x,?- + q)<H(x,p + q) ^ ~ l) 



jJL jX 

In the optimal control/dynamical system approach, the following assump- 
tions are used 

(A7) The function H is convex, i.e., for each i6fl the function p 1— > H(x,p) 
is convex on R n and either of the following assumption (A7)+ or (A7)_ 
holds. 

(A7)± There exists a modulus w satisfying u(r) > for r > such that for 
any (x, p) G Cl x W l , if H(x,p) = c, £ G d p H(x, p) and g G M n , then 

if (x, p + g)>c + £- g + w((£ • g)±). 

We point out that we use the notation d p H(x, p) for the convex sub differential 
of the function p h-> H(x,p) where x is fixed. 
Our main result is the following theorem. 

Theorem 1.5 (Large-Time Asymptotics). Assume (A0)-(A6) or (A0)-(A5) 
and (A7). For any uq G C{VL), if u is the solution of (CN) {resp., (DBC)) 
associated to uq, then there exists a solution v G W 1,oc (Vt) of (El) {resp., 
(E2)), such that 

u(x,t) — > v(x) uniformly on Q as t — >■ 00. 

Remark 1.1. (i) Under the convexity assumption on H of (A7), the assump- 
tions (A1)-(A6) are equivalent to (Al)-(A5) and (A7), and therefore (Al)- 
(A5) and (A7) imply (Al)-(A6). Indeed, under (Al) and the convexity as- 
sumption on H, conditions (A7)± are equivalent to (A6)±, respectively, This 
equivalence in the plus case has been proved in [16, Appendix C]. The proof 
in the munis case is similar to that in the plus case, which we leave to the 
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interested reader, (ii) We notice that if H is smooth with respect to the p- 
variable, then (A6) is equivalent to a one-sided directionally strict convexity in 
a neighborhood of the level set {p £ M. n : H(x,p) = 0} for all x £ TP 1 , i.e., 

(A6') there exists r] > such that, for any r\ £ (0, rjo], there exists ij} v > 
such that if H(x,p+q) > r) and H(x,q) < (or if H(x,p+q) < —rj and 
H(x, q) < 0) for some x £ T n and p, q £ lR n ; then for any fi £ (0, 1] , 

D p H(x, p + q) ■ p- H(x, p + q) > ip v . 

(hi) Let us take the Hamiltonian H(x,p) := (\p\ 2 — l) 2 for instance. If we 
consider the homogeneous Neumann condition, then we can easily see that the 
additive eigenvalue is 1. This Hamiltonian is not convex but satisfies (A6) 
(and (A6')). 

2. Asymptotic Behavior I : the PDE approach 

As we mentioned it in the introduction, we provide the proof of Theorem 
1.5 only in the case of the nonlinear dynamical-type boundary value problem 
(DBC). In the case of the nonlinear Neumann-type boundary condition, the 
proof is simpler and we will only give a remark at the end of this section. 

In order to avoid technical difficulties, we assume that u is Lipschitz con- 
tinuous (and therefore the solution u of (DBC) is Lipschitz continuous on 
Q x [0, oo)). We can easily remove it by using (1.1). 

As in [7, 5] the asymptotic monotonicity of solutions of (DBC) is a key 
property to get convergence (0.1). 

Theorem 2.1 (Asymptotic Monotonicity). 

(i) (Asymptotically Increasing Property) Assume that (A6)+ holds. For 
any rj £ (0, rjo], there exists 5 V : [0, oo) — > [0, oo) such that lim^oo 5 v (s) — > 
and 

u(x, s) — u(x, t) + r](s — t) < 5j,(s) 
for all x £ f2, s,t £ [0, oo) with t > s. 

(ii) (Asymptotically Decreasing Property) Assume that (A6)_ holds. For 
any rj £ (0, rjo], there exists 5 V : [0, oo) — > [0, oo) such that lim^oo 5 v (s) — > 
and 

u(x, t) — u(x, s) — r](t — s) < S^s) 
for all x £ Q, s,t £ [0, oo) with t > s. 

The proof of Theorem 1.5 follows as in [7, 5]: we reproduce these argu- 
ments for the convenience of the reader. 

Since {«(-, t)} t >o is compact in W 1 '°°(fl), there exists a sequence {u(-, T„)} n eN 
which converges uniformly on Q as n — > oo. Theorem 1.1 implies that we have 

\\u{-,T n + •) - u(-,T m + -)||L°°(nx(o,oo)) < \\u{-,T n ) - u(-,T m )\\ L ^ {n) 

for any n, m £ N. Therefore, {u(-,T n + -)} n6 N is a Cauchy sequence in C(Q x 
[0, oo)) and it converges to a function denoted by u°° £ C(Q x [0, oo)). 
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Fix any 16O and s, t G [0, oo) with t > s. By Theorem 2.1 we have 
u(x, s + T n ) - u(x, t + T n ) + t](s - t) < 5 v (s + T n ) 

or 

u(x, t + T n ) - u(x, s + T n ) - rj(t - s) < 5 v (s + T n ) 

for any n 6 N and 77 > 0. Sending n — > oo and then r\ — )■ 0, we get, for any 
t > s 

u°°(x,s) < u°°(x,t). 

or 

u°°{x,t) < u°°(x,s). 

Therefore, we see that the functions x i— > u°°(x,t) are uniformly bounded and 
equi-continuous, and they are also monotone in t. This implies that u°°(x, t) — > 
w(x) uniformly on Q as t — > oo for some w G W 1,00 (Q). Moreover, by a 
standard stability property of viscosity solutions, w is a solution of (DBC). 
Since «(•, T n + •) — >■ u°° uniformly in Q x [0, oo) as n — > oo, we have 

-o n (l)+u°°(x,t) <u(x,T n + t) <u°°(x,t) + o n (l), 

where o n (l) — > oo as n — > oo, uniformly in x and t. Taking the half-relaxed 
semi- limits as t — )■ +oo, we get 

— o n (l) + w;(x) < liminf* t) < limsup* u(x, t) < w(x) + o„(l). 

Sending n — > oo yields 

w(x) = liminf* u(x, t) = limsup* u(x, t) 

t— >oo t— >oo 

for all x £ £1. And the proof of Theorem 1.5 is complete. 
Now we turn to the proof of Theorem 2.1. 

Noticing that the additive eigenvalue is again, by Proposition 1.4 the 
solution u of (DBC) is bounded on fl x [0, oo). We consider any solution v of 
(E2). We notice that v — M is still a solution of (E2) for any constant M > 0. 
Therefore subtracting a positive constant to v if necessary, we may assume 
that 

1 < u(x, t) - v(x) < C for all (x, t) G H x [0, oo) and some C > (2.1) 

and we fix such a constant C. 

We define the functions /i^ : Q x [0, oo) — > R by 

, . , fu(x, t) — v(x) + nit — s) \ 

(j+(x,s) :=min 1 ' \> \ >-), 2.2 

' t>s V u(x, s) — v[x) / 

_ /u(x,t) -v(x) -rj(t- s)\ 

li (x, s) := max 

n t>s \ u(x, s) - v(x) ) 

for r] G (0,?7o]. By the uniform continuity of u and v, we have /i^ G C(f2 x 
[0, oo)). It is easily seen that < /i^(x, s) < 1 and /i~(x, s) > 1 for all 
(x, s) G Q x [0, oo) and 77 G (0, 770] . 
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Lemma 2.2. (i) Assume that (A6) + holds. The function //+ is a supersolution 
of 

max{w — 1, w t + M\Dw\ 

+ ^(w-l)} = in ftx(0,oo), (2.3) 

max{w — 1, w t + F(x, Dw)} = on <9ft x (0, oo) 
for any n G (0, 770] and some M > 0, where 

F(x,p) := -K(-p ■ n(x)) + M B \p - (p ■ n(x))n(x)\, (2.4) 

and 

( dr ifr > 0, 

*V ,fr<0. (2 ' 5 > 

(ii) Assume that (A6)_ holds. The function \l~ is a subsolution of 

min{w — 1, Wt — M\Dw\ 

ib n w — 1 ., ^ 

+ 77 } = in fix (0,oo), 

O w 

min{w — 1, w t — F(x, —Dw)} = on dfl x (0, 00) 

for any 77 G (0, 770] and some M > 0. 

Before proving Lemma 2.2 we notice that Lemma 2.2 implies 

fj£(', s) — > 1 uniformly on ft, 

/_t~(-, s) — > 1 uniformly on ft 

as s — > 00. Indeed noting that r H- F(x,p + rn(x)) — min{#, M B }r is non- 
decreasing and the function (r — l)/r is increasing for r > 0, we see that the 
comparison principle holds for both of Neumann problems 

max{w - 1, M\Dw\ + -^(w - 1)} = in ft, , n „, 

C (2-6) 

maxjw — 1, F(x, Dw)} = on <9ft, 

min{w - 1, -M\Dw\ + ^ } = in ft, 

C w (2.7) 

min{?i; — 1, —F(x, —Dw)} = on <9ft. 

Moreover we have liming /_t+, 1 are solutions of (2.6) and limsup*/i~, 1 are a 

subsolution and a solution of (2.7), respectively. Therefore from these obser- 
vations we see liminf* \i j" = 1 and limsup* \C = 1, which imply the conclusion. 

Proof of Lemma 2.2. We only prove (i), since we can prove (ii) similarly. Fix 
77 G (0, 770] an d let //+ be the function given by (2.2). We recall that fit(x, s) < 1 
for any x G ft, s > 0. 

Let G C 1 (ft x [0, 00)) and (£, a) G ft x (0, 00) be a strict local minimum 
of — 0, i.e., fj^(x, s) — 4>(x, s) > fJ^(£, o~) — </>(£, a) for all (x, s) G ft x [a — 
r, a + r] \ {(£, a)} and some small r > 0. Since we can get the conclusion by 



and 
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the same argument as in [7] in the case where £ G Q, we only consider the case 
where £ G dQ in this proof. Moreover since there is nothing to check in the 
case where pt(C, er) = 1 or 0t(£, cr) + D(j)(£, a)) > 0, we assume that 

/i+(£, a) < 1 and a) + F(£, D<j>(£, a)) < 0. (2.8) 

We choose r > a such that 

We write p for /i+(£, a) henceforth. 

Next, for a > small enough, we consider the function 

. , u(x, t) — v(x) + T](t — s) . ,, , 

x, t, s) ^ V ! , \ 1 ,'\ - + x- C 2 + (t - r 2 - 4>(x, s) + 3ap(x), 

u{x, s) — v(x) 

where p is the function which is defined just after (AO). We notice that, for 
a = 0, (£, r, cr) is a strict minimum point of this function. This implies that, 
for a > small enough, this function achieves its minimum over fix{(t,s) : 
t > s, s G [cr — r, a + r]} at some point (£ a , £„, s a ) which converges to (£, r, cr) 
when a — » 0. Then there are two cases : either (i) £ a G f2 or (ii) £ a G <9f2. We 
only consider case (ii) here too since, again, the conclusion follows by the same 
argument as in [7] in case (i). In case (ii), since p(£ a ) — 0, the cv-term vanishes 
and we have (£ Q , t a , s a ) = (£, r, a) by the strict minimum point property. 

For any 5 G (0, 1) let Cf' 5 and C^ 6 G C 1 (M n ) be, respectively, the functions 
given in Lemma 4.2 with a = pi/p,b = —rj/p and a = jz^,b = 0, and let 

Xi and X2 be, respectively, the functions given in Lemma 4.3 with C|'* = C\ ,S 

and Cf 5 for e > 0. We set K := if x {(t, s) : t > s, s G [a - r, a + r]}. We 
define the function \& : K — > R by 



W(x,y,z,t, s) 

u(x, t) — v(z) + T)(t — s) 



u(y, s) - v(z) 

+ \x- £| 2 + {t- r) 2 - a{p{x) + p{y) + p{z)). 

In view of Lemma 4.3, if A > M 2 , where A is the constant in Xi-,X2, then 
\1/ achieves its minimum over K at some point (x, y, z, t, s) which depends on 
a, 8, e. By taking a subsequence if necessary we may assume that 

x, y, z — > £ and t — > r, s — ^ a as e — > 0. 

Set 

A*i : = u(y,s) -v(z), p 2 := u(x,t) -v(z) +r](t-s), ~p := 



y — x z — x 

p := — ^ — and c/ : 



and then we have 

pZ x — > pi, ~p 2 — > P2-, /I — > /i as e — 7- 0. 
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Therefore we may assume that /i < 1 for small e > 0. 
Claim: There exists a constant M3 > such that 



|p| + |g| < m 3 

for all e, 5, a £ (0, 1). 

We only consider the estimate of \p\, since we can obtain the estimate of \q\ 
similarly. The inequality ^(x, y, z, t, s) < ty(x,x,z,t,s) implies 



Xi(x-y) 



1 



1 



u(x, s) — v(z) u(y, s) — v(z) 
<L 2 \x-y\ 



a\p(x) - p(y)\ + \(f>(x, s) - (f)(y, s)| 

(2.9) 



for some Li,L 2 > 0. Combining this (2.9) and the inequality in Lemma 4.3 (i) 
we get the conclusion of Claim for M3 := 4 (Mi + L2). 



In the sequel, we denote by o e (l) a quantity which tends to as e — > 0. 
Derivating \1/ with respect to each variable t,s,x,y,z at (of, y, ~z, t, s) formally, 
we have 



u t (x, t) = -7] - 2/j 1 (t - r) = -77 + o 6 (l), 
= --(r] + Jl 1 (f) s (y,s)), 

= (77 + //I0 a (£, 0")) +O e (l), 

/i 

D x u(x,t) =Jl 1 {-D x xi(x -y) - D x X2(x -z) +2(£-x) - ah(x)} 
= m{-D x xi(x-y) - D x X2(x-z) - cm(f)}+o e (l), 

D y u(y,s) = ={D y xi(x- y) - D<j>(y,s) + an(y)} 

= - 17) - £>0(e, + tm(0} + o e (l), 

= t^={I>*X2(s-2) + «n(z)} 
1 — 

= T^{^X 2 (x - 2) + cm(0} + o 6 (l). 



We remark that we should interpret Ut, u s , D x u, D y u, and D z v as the viscosity 
solution sense here. 
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We first consider the case where x G dVL. In view of Claim, (A3)-(A5) and 
Lemma 4.3 (ii) we have 

u t (x, t) + B (x, D x u (x, t) ) 

< - r) + B(x, -(ti(D x xi(x - y) + D xX2 (x- z))) - 8/iia + o E (l) 

< p{-^ + B(x, -^D xXl (x - J/)) }+(l - fi)B(x, p^D xX2 (x - z)) } 

- 6^ x a + o e (l) 
<m(£ + o e (l)) -9tna + o e (l), 

where m is a modulus. Therefore u t + B(x, D x u(x,t)) < for e, 5 > which 
are small enough compared to a > 0. Similarly if ~z G <9f2 then we have 
B(z,D z v(z)) > 0. 

We next consider the case where y G dfl. Note that we have 

B(x,p + q) > B(x,p) + K(q ■ n(x)) — M B \qr\, 

for any x G <9f2, p,q G 5(0, A/3), where qr '■= q — {q ■ n(x))n(x) and A' is the 
function defined by (2.5). By Lemma 4.3 and the homogenity with degree 1 
of F with respect to the p-variable, we have 

u s (y,s) + B(y, D y u(y,s)) 



V 



(- Ml 



x 



V)) 



oJl) 



>-m(5 + o e (l)) + ^ - ^ a) + F(£, I>0(£, a))) + o e (l) 

> _ m(5 + 0£ (i)) + ^ + 0£ (i). 

Again, for e, 5 > which are small enough compared to a > 0, we have 

u,(y,s) + B(y,D y u(y,s)) > . 
Therefore, by the definition of viscosity solutions we have 

-77 + o B (l) + H(x, D x u(x, t)) > 0, 

— (77 + A*i^(e, cr)) + o e (l) + if (y, D„«(|7, a)) < 0, 
A* 

(2, £),«(«)) <0. 



(2.10) 



In view of the above claim by taking a subsequence if necessary we may 
assume that 

- —D x xi{x-y), —D y xiix-y) P, and 
ji /i 



/'i 



1 — n 

as e -> for some P,Q E W 1 . 



D xX2 (x - z), 



/'1 



-A:X2(z - z) ->■ Q 
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Sending e — > 0, 5 — > and then a — > in (2.10), we obtain 

H{£,nP+(l-y)Q)>n, 

-^(77 + Ml s (£, a)) + H{£, P - jD<f>(£, a)) < 0, 

H{C,Q)<0. 

We use these three inequality in the following way : first, using (A2), the 
second one leads to 

--(»? + a)) + H(C, P) - M^\D<f>(£, a)\<0, 

for some constant M > 0. It remains to estimate H(£,P). 
Set P := fi(P - Q). By (A6)+ we obtain 

H{£,nP+{l-fiQ) = H(Z,P + Q) 

< //#(£, - + Q) - $ „(1 - fi) = /!#(£, P) - ^(1 - n) 

for some ip v > 0. We therefore have 

1(^ + ^(1-^)) <H{{,P). 
H 

Using this estimate in our first inequality yields the desired result, namely 

<M£, <t) + M\D<f>(£, a) | + ^(/i - 1) > 0. □ 

Remark 2.1. We remark that the solution of (CN) has the asymptotic mono- 
tonicity property. In order to prove this, we mainly use the following lemma 
in place of Lemma 2.2. 

Lemma 2.3. Set 

'u(x, t) — v(x) + T)(t — s) 



mm 



xeo,t>s v u{x,s) - v{x) 

'u(x, t) — v(x) — T)(t — s) 



H [s := max 
' xen,t>s V u{x, s) - v{x) 

for 7] G (0, 770] - 

(i) Assume that (A6) + holds. The function /x+ is a supersolution of 

xb 

max{w(s) — 1, w (s) + — ^ ■ (w(s) — 1)} = in (0, oo) 
/or any 77 G (0, 770] . 

(ii) Assume that (A6)_ holds. The function [i~ is a subsolution of 

■ r f \ 1 'n 1 w ( s ) ~ X \ n ■ ^ 
mm{u>(s) — 1, it) (s) + — j ■ — — } = in (0, 00) 

for any 77 G (0,770]. 
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3. Asymptotic Behavior II : the optimal control/dynamical 

SYSTEM APPROACH 

As we mentioned in the introduction, we mainly concentrate on Problem 
(CN) in this section. 

3.1. Variational formulas for (CN) and (DBC). We begin this section 
with an introduction to the Skorokhod problem. Let x G dQ and set 

G(x,£) = sup (£-p-B(x,p)) for£GK n , 



Q{x) = {(7,0) ei n xl: B(x,p) >J-p-g for all p G W 1 }. 
By the convex duality, we have 

G(x) = {(i,g) G R n+1 : 5>G(x, 7 )}. 



Note that 



> -B(x, 0) > -maxB(y, 0), 
|J d p B(x,p) C {7 G R n : G{x,i) < 00}, 



(J d p B(x,p) = {7 G R n : G(s,7) < 00}. 



r(x)= |J «9 pJ B(x,p), 



We set 



and observe that r(x) C JBmj 7 ■ n(x) > 6* for 7 G -T(x), (?(x) is a convex 
subset of M n+1 and -T(x) is a closed convex subset of lR n . Observe as well that 
if (7, g) G M n+1 belongs to Q{x) for some x G <9f2, then G(x, 7) < 00 and hence 

7 g r(x). 

For example, if B(x,p) = 7(2) ■ p — g(x) for some functions 7, g G C(<9f2), 
then 

if 6 = 70), 
^ 00 otherwise, 
and 

Q(x) = {(7(x),r) : r > g(x)} = {7(2;)} x [g(x), 00), r(x) = {j(x)}. 

Let x G and < T < 00, and let 77 G AC([0,T],R n ), v G ^([O, T], R n ) 
and / G L 1 ([0,T],M). We introduce a set of conditions: 

' 7/(0) = x, 
r/(t) G for all £ G [0, T], 

Z(t) > for a.e. t G [0, T], ^'^ 
Z(t) =0 if 77(f) G Q for a.e. t G [0, T], 
and 

there exists a function / G -^ 1 ([0, T], M) such that (3.2) 
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((v - r,)(t), f(t)) G l(t)g( V (t)) for a.e. t G [0, T]. 
Observe here that the inclusion 

is equivalent to the condition that f(t) > l(t)G(r)(t), Z(t) _1 (i>— f])(t)) if Z(t) > 0, 
and fj(t) = v(t) and f(t) = if l(t) = 0. Condition (3.2) is therefore equivalent 
to the condition that 

the function t \-> l{t)G (r}(t), /(t) _1 (?j - fj)(t)) is integrable on [0, T], (3.3) 
and 77(f) = v{t) if l(t) = for a.e. t G [0, T]. 

Here we have used the fact that G is lower semi-continuous (hence Borel) func- 
tion bounded from below by the constant — max^ggn B(x, 0). The expression 
l(t)G(r](t), -f})(t)) hi (3.3) is actually defined only for those t G [0, T] 

such that l(t) > 0, but we understand that 

(l(t)G( V (t),l(t)- l (v-r,)(t)) if l(t)>0, 

[0 otherwise. 

Similarly we henceforth use the convention that zero times an undefined quan- 
tity equals zero. With use of this convention, we define the function F(rj,v,l) 
on [0, T] by 

F( v ,v,l)(t) = l(t)G( V (t), l(t)-\v(t)-r,(t)))- 

We remark that under assumption (3.3) we have for a.e. t G [0, T], 

F{r],v,l)(t)>(v-rj)(t)-p-l(t)B{r]{t),p) for all p G R n . (3.4) 

In the case where B(x,p) = j(x) -p — g{x) for some 7, g G C(dQ), it is easily 
seen that condition (3.3) is equivalent to 

77(f) + l(t)j(r](t)) = v(t) for a.e. t G [0, T]. 

(Compare this together with (3.1) with (1.4) in [22].) In this case we have 
F(rj,v,l)(t) = l(t)g(rj(t)) for a.e. t G [0, T]. 

Now, given a point x G 0, a constant < T < 00 and a function v G 
-^ 1 ([0, T], M n ), the Skorokhod problem is to find a pair of functions rj G AC([0, T], 
and Z G ^([0, T], R) for which (3.1) and (3.2) are satisfied. 

Theorem 3.1. Let x G tt, < T < 00 and v G L^fO, T], M n ). T/iere exzsfo 
a solution (77, /) 0/ i/ie Skorokhod problem. Moreover, there exists a constant 
C > 0, independent of x, T and v, such that, for any solution (77, I) of the 
Skorokhod problem, the inequalities \rj(t)\ < C\v(t)\ and l(t) < C\v(t)\ hold for 
a.e. t G [0, T]. 

For fixed x G Q and < T < 00, SPr(x) denotes the set of the all 
triples (77, u, Z) of functions rj G AC([0, T], W 1 ), v G ^([0, T],M n ) and I G 
L 1 ([0, T], i?) such that conditions (3.1), (3.2) are satisfied, and SP(x) denotes 
the set of the triples (77, v, I) of functions 77, v and I on [0, 00) such that, for all 
< T < 00, the restriction of (77, v, I) to the interval [0, T] belongs to SPr(x). 
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Note here that if (77, v , I) £ SPt(x) for some x £ and < T < 00 and if 
we extend the domain of (77, v, I) to [0, 00) by setting 

rj(t) = r)(T), v{t) = 0, and l(t) = for t > T, 

then the extended (r),v,l) belongs to SP(x). 
Moreover we set 

SP r = (J SP r (x) and SP = (J SP(x). 

Let m £ C(pL). For i > we set 

U{x,t)=vd{ y < (L(r / ( S ),- W ( S )) + /( S ))d S + n (^(t)) : (77, f , Z) £ SP(x)|, 

(3.5) 

where L(x,£) := sup eRn (£ -p — H(x,p)) and / := F(r),v,l). We call the 
function L the Hamiltonian of 7Z. This function has the properties: L(x,£) 
is lower semicontinuous on Q x IR n , convex in £ £ R n and coercive, i.e., 
limigi-s.oo L(x, £) = 00 for all a; £ Q. The function L may take the value 
00, but sup^ xBr L < 00 for some constant r > 0. 

Theorem 3.2. The function U is continuous on Cl x (0, 00) and a solution of 

u t + H{x,Du) = mfix(0, 00), (3.6) 
5(x, D«) = on <9fi x (0, 00). (3.7) 

Moreover, we have 

lim U(x,t) = u (x) uniformly on Cl. 

We set U(x, 0) = u (x) for x £ 0. The above theorem ensures that £7 £ 
C(£l x [0, cx))) and U is a solution of (CN). 

In what follows we give an outline of proofs of Theorems 3.1 and 3.2. Indeed, 
most of the arguments parallel to those for similar assertions in [22] for (CN) 
with linear Neumann boundary condition. 

Lemma 3.3. Letip £ C(dn,R n ) ande>0. There exists (j,g) £ C(dn,M. n+1 ) 
such that for all x £ dQ, (j(x),g(x)) £ Q(x) and B(x, ip{x)) < e+ r y(x)-i/;(x) — 
9(x). 

Proof. Let § > and set 



B s (x,p) = inf [B(x, q) + — \p - q\ 2 ) for all (x,p) £ dil x R n . 

r£M" V 25 J 

Note that B$ < B on d£l x W\ that, as 5 — > 0, Bg(x,p) — >■ B(x,p) uniformly 
on <9f2 x Br(0) for every i? > and that for x £ <9f2, the function p 1— > Bs(x,p) 
is in C 1+1 (R n ). Also, by (A4) we see that 

Bs(x,p) = min ( B(x, q) + —\p — q\ 2 J for (x,p) £ <9f2 x R n 
|p-?|<R V 25 J 
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for some R > depending only on 5 and Mb- Hence, B$ G C(dQ x M n ). 
Moreover, it is easy to see that D p Bs G C(dQx~R n ). Indeed, if (xj,Pj) —> (y, q) 
as j — > oo and ^ := D p Bs(xj,Pj), then 

Bs(xj,p) > B s (x j ,p j ) + £j • (p - pj) for all p G R n . 

Noting that |^| < Mb, we may choose a subsequence {^j fc }fceN, converging to 
a point r), of {Cj}- From the above inequality with j = j^, we get in the limit 

B s (y,p) >v(p-q) + B s(y, q) for v e R n - 

This shows that ?7 = D p Bs(y,q), which implies that lim^oo D p B$(xj,pj) = 
D p B s (y,q) and D P B 5 G C(dn x R n ). 

If we set j(x) = D p B$(x,ip(x)) and g(x) = j(x) ■ ip(x) — Bs(x,ip(x)), then 
we have for all (x,p) G d£l x M. n , 

B(x,p) > B s (x,p) > 7(x) • (p - ip(x)) + B s (x,ifj(x)) = 'y(x) ■ p - g(x). 

Thus, we find that (7(x), g{x)) G G{x) for all x G dVt. Moreover, for each fixed 
e > 0, if 5 > is small enough, then we have 

B(x, ip(x)) < e + Bs(x, ip(x)) = e + j(x) ■ ip(x) — g(x). 

Finally, we note that (7,(7) G C(dQ,W n+1 ) and conclude the proof. □ 

Lemma 3.4. Let < T < 00. There is a constant C > 0, depending only on 
9 and Mb, such that for any (77, v, I) G SPr, 

max{|?)(s)|, l(s)} < C\v(s)\ for a.e. s G [0, T}. 

Recall that Mb > is a Lipschitz bound of the functions p 1— > B(x,p) for 
all x G <9f2. 

An immediate consequence of the above lemma is that for (77, v, I) G SP, if 
I is an interval of [0, 00) and v G L P (I, M n ), with 1 < p < 00, then (?), /) G 
W{I, R n+1 ). 

Proof. Let (77, v,l) G SPr and set £ = v — rj on [0, 00). We choose a function 
/ G ^([0, T],R) so that ((v - f])(s),f(s)) G l(s)G(rj(s)) for a.e. s G [0, T). 
If /(s) = for a.e. s G [0, T], then we have = v(s) for a.e. s G [0, T], 
which yields max{|?)(s)|, l(s)} = \v(s)\ for a.e. s G [0, T], and we are done. 
Henceforth we assume that the set E := {s G [0, T] : /(s) > 0} has positive 
measure. We choose a subset E of -E having full measure so that E C (0, T), 
that 77(5) G <9f2 and ((u — r))(s), f(s)) G /(s)^(?7(s)) for all s <E E and that r] is 
differentiable everywhere in E . We set 7(5) = — for s G E , 

and note that j(s) G r(rj(s)) for all s G £"0- 

Using the defining function p (cf. (AO)) and noting that p(r](s)) < for all 
s G [0, T], we find that for any s E E Q , 

= 4-Av(s)) = Dp( V (s)) ■ r}(s) = \Dp( V (s))\n( V (s)) ■ (v(s) - l(s)^s)). 
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That is, n(r)(s)) ■ v(s) = l(s)n(rj(s)) ■■y(s) for all s G E . Fix any s G E . Since 
7(s) G r(r)(s)), we have |7(s)| < M and 7(5) -71(77(5)) > 6*|7(s)|. Accordingly, 
we get 

\v(s)\ > n(rj(s)) ■ v(s) = 77,(77(5)) • /(s)7(s) > l(s)9, 

and hence, l(s) < \v{s)\/9. Finally, we note that \f)(s)\ < \v(s) \ + |£(s)| < 
(1 + M/6)\v(s)\, which completes the proof. □ 

Proof of Theorem 3.1. Fix x G Q, < T < 00 and v G L^fO, T],W n ). Due to 
Lemma 3.3, there exists a (7,(7) G C(<9f2, M n+1 ) such that (j(x), g(x)) G <?(x) 
for all x G <9f2. According to [22, Theorem 4.1], there exists a pair (77, Z) G 
AC([0, T],M n ) x L x ([0, T],R) such that 77(0) = x, rj(s) G ft for all s G [0, T] 
and for a.e. s G [0, T], 

/(s) > 0, Z(s) = if 77(5) G f2, and 77(5) + l(s)y(ri(s)) = v(s). 

We set f(s) = l(s)g(r](s)) for s G [0, T], and observe that we have for a.e. 
s G [0, T], 

((« - 17) (a), f(s)) = /(a) ( 7 (a), <?00) G /(a)SfoOO), 

completing the existence part of the proof. The remaining part of the proof is 
exactly what Lemma 3.4 guarantees. □ 

Proof of Theorem 3.2. Set Q = Cl x (0, 00). We first prove that U is a sub- 
solution of (3.6), (3.7). Let (x,t) G Q and (f) G C^Q). Assume that U* - <j> 
attains a strict maximum at (x,t). We need to show that if x 6 Q, then 
4> t (x,t) + H(x, D(f)(x,t)) < 0, and if x G dfl, then either 

4 (x, t) + H(x, D(j)(x, i)) < or B(x, D<f>(x, t)) < 0. (3.8) 

We are here concerned only with the case where x G dQ. The other case 
can be treated similarly. To prove (3.8), we argue by contradiction. Thus 
we suppose that (3.8) were false. We may choose an e G (0, 1) so that 
<j>t(x, i) + H(x, D(j)(x, t)) > e and B(x, D(j)(x, i)) > e. 

By Lemma 3.3, we may choose (7, G C(dQ, M n+1 ) so that (j(x), g(x)) G 
Q{x) for all x G dVt, and i?(x, D<j)(x, £))<£ + 7(f) ■ D0(£, t) - #(£). Note that 
7(x) • D(f)(x,i) - #(x) > 0. Set i? = B 2e {x) x [t - 2e, i + 2e]. By replacing 
e > if needed, we may assume that £ — 2e > and for all (x, t) G R D Q, 

(f) t (x,t)+H(x,D(j)(x,t))>£ and 7(2) • £>0(x, t) - 0(2;) > 0, (3.9) 

where 7 and g are assumed to be defined and continuous on Q. We may 
assume that (U* — </>)(£, t) = 0. Set m = — maxQ n g R (U* — (p), and note that 
m > and U(x, t) < 0(x, t) — m for (x, i) G Q D OR. We choose a point 
(x,t) G (-B E (£) x [i-e, i+e]) HQ so that (?7-0)(x,t) > -m. 

Now, we consider the Skorokhod problem with the function j(x) ■ p — g(x) 
in place of B(x,p). For the moment we denote by SPy(x; j,g) the set of all 
(rj,v,l) G AC([0, T],M") x L^fO, T],R n ) x L^fO, T],R) satisfying (3.1) and 
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(3.2), with the function r y{x)-p—g{x) in place of B(x, p). We apply [22, Lemma 
5.5], to find a triple (r), v, I) G SPt(x ; 7, g) such that for a.e. s G (0, t), 

H( V (s), Defies),!- s)) + L( V (s), -v(s)) < e - v(s) • D<f>( V (s),t - s) (3.10) 

Note here that, since (rj,v,l) G SP^x; 7,(7), we have rj(t) + /(s)7(s) = v(s) 
and F(r],v,l)(s) = l(s)g(r](s)) for a.e. s G [0, t\. 

We set (j = min{s > : (r}(s),t—s) G dR} and note that (r](s),i—s) G Qni? 
for all < s < a and < o < i . Using the dynamic programming principle, 
we obtain 

(f)(x,i) <U(x,t) + m 

< [ (L(rj(s),-v(s))+g(r](s))l(s))ds + U(rj(a),t-a) + m 
Jo 

< [ (L(77(s),-u(a))+^(a))Z(a))ds + 0(77(<T),f-a). 
Jo 

Hence, setting p(s) := D(f>(r](s), t — s), we get 

0< / (L(7)(s),-v(s))+g(7)(s))l(s) + ^<f>(7)(s),t-s))ds 



ds 

< [ (L{r}{s),-v{s))+g{r]{s))l{s)+ P {s)-{v{s)-l{s)j{r}{s)) 
Jo 

- Mv(s),t- s)) ds. 
Using (3.10) and (3.9), we obtain 

0< / { £ -if(7 7 (s),p( S ))-0i(77( S ),t- S )+K S )^(7 7 ( S ))-7(7 7 ( S ))^( S ))}d S <O, 



which is a contradiction. Thus, U is a subsolution of (3.6), (3.7). 

Next, we turn to the proof of the supersolution property of U . Let <fi G C 1 (Q) 
and (x, t) G Q. Assume that £/* — <f> attains a strict minimum at (x, t). We 
need to show that if x G f2, then 0t(x, t) + i?(x, D(j)(x, t)) > 0, and if x G <9f2, 
then either 

<f) t {x,i) + H{x,D<p(x,t)) > or £(x, D<p(x,i)) > 0. (3.11) 

As before, we only consider the case where x G dfl. To prove (3.11), we sup- 
pose by contradiction that 4> t (x,i)+H(x, D(j)(x,i)) < and B(x, _D0(x,t)) < 
0. There is a constant e > such that 

<fi t (x,t) + H(x, D<fi(x,t)) < and 

5(x, Dcj)(x,t)) < for all (x, t) G i? n Q, 

where i? := B 2£ (x) x [£ — 2e, t + 25]. Here we may assume that t — 2e > and 
(t/*-0)(x,t) = 0. 

Set m := mingr,,^?/* — 0) (> 0). We may choose a point (x,F) G (-B e (x) x 
(i — e,i + e))nQ so that ([/ — 0)(x, t) < m. We select a triple (77, t> , /) G SP(x) 
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so that 

U(x,t) + m> f (L(r)(s),-v(s)) + f(s))ds + u (r)(t)), 
Jo 

where / := F(r),v,l). We set a = min{s > : (r](s),t — s) £ dR}. It is clear 
that a > and r](s) E RC\Q for all s £ [0, a]. Accordingly, we have 

<f>(x,I) + m> [ (L{7i(s),-v{s)) + f{7i{s)))ds + U{7i{<T),t-a) 
Jo 

> / (L(ri(a),-v(8)) + f(ri(8)))da + <l>(ri(<T),i-a)+m, 
Jo 

and hence, 

> / {L(rj(s), -v(s)) + f(rj(s)) + D(j>(rj(s),t - s) ■ f](s) - Mv(s),i- s)) ds. 
Jo 

Note by the Fenchel- Young inequality and (3.4) that for a.e. s £ [0, a], 

L( V (s), -v(s)) + f(s) > -r,(s) ■ p(s) - H( V (s), p(s)) - l(s)B(r,(s), p(s)), 
where p(s) := D(f)(j](s),t — s). Consequently, in view of (3.12) we get 

> / ( - H(r)(s), p(s)) - MvW, t-s)- l(s)B(rj(s) : p(s))) ds > 0, 
Jo 

which is a contradiction. The function U is thus a supersolution of (3.6), (3.7). 

It remains to show the continuity of U on x [0, oo). In view of Theorem 
1.1, we need only to prove that 

U*(x,0) < U*{x,0) forallx£fi. (3.13) 

Indeed, once this is done, we see by Theorem 1.1 that U* < U* on Q x [0, oo), 
which guarantees that U £ C(fl x [0, oo)). 

To show (3.13), fix any e > 0. We may select a function u £ Q £ C 1 (f2) such 
that B(x, Duq(x)) < for all x £ <9f2 and 

\u (x) — Uq(x)\ < e for all x £ fl. 

Indeed, we can first approximate Uq by a sequence of C 1 functions and then 
modify the normal derivative (without modifying too much the function itself) 
by adding a function of the form e((Cp(x)/e) where ( is a C 1 , increasing 
function such that C(0) = 0, C'(0) = 1 and -1 < £(r) < 1 for all r £ R. 

Then we may choose a constant C e > so that the function ip(x,t) := 
Uq(x) —C £ t is a (classical) subsolution of (3.6), (3.7). Then, for any (x,t) £ Q 
and (r),v,l) £ SP(x), we have 

0) - ^(77(0), t) = [ (Di/;(ri(s), t-s)- f)(s) - ^(77(5), t - s)) ds. 



Setting p(s) = Dil>(r](s), t — s) and f(s) = F(rj, v, l)(s) for s £ [0, t] and using 
the Fenchel- Young inequality, we observe that for a.e. s £ [0, t], 

p(s) ■ T](s) - Mv(s), t-s)> -L(rj(s), -v(s)) - f(s). 
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Combining these observations, we obtain 

if>(x,t)< f (L(r)(s),-v(s)) + f(s))ds + u e (x), 
Jo 

which ensures that U(x,t) > Uq(x) — 2e — C e t for all (x,t) G Cl x [0, oo), and 
moreover, U*(x, 0) > Uq(x) for all x G 0. 

Next, fix any (x, t) G Q and set rj(s) = x, v(s) = and l(s) = for s > 0. 
Observe that (77, u, Z) G SP(x) and that -F(/7, f , /) = and 

U(x,t) < / L(x, 0) ds + Uq(x) = L(x, 0)t + u (x) < u (x) — t minH(x, 0). 
Jo x&n 

This shows that U*(x,0) < u (x) for all x G Cl. Thus we find that (3.13) is 
valid, which completes the proof. □ 

Next we present the variational formula for the solution of (DBC). The 
basic idea of obtaining this formula is similar to that for (CN), and thus we 
just outline it or skip the details. 

We define the function W on Q := x (0, , 00) by 

W(x, t) = inf (L(77(s), -v(s)) + f(s)) ds + uofoW)}, (3.14) 

where the infimum is taken all over (j],v,l) G SP(x), / = F(rj,v,l), and 
cr g (0, t] is given by t = Jq(1 + l(r)) dr. Then we extend the domain of 
definition of W to Q by setting W(x, 0) = u (x) for x G 0. 

In the definition of FT we apparently use the set SP (the Skorokhod problem 
for Q and B), but the underlining idea is to consider the Skorokhod prob- 
lem for the domain Q x R and the function B(x,p) + g in place of Q and 
B(x,p), respectively. Indeed, setting Cl = Q x K, B(x,p,q) = B(x,p) + g and 
H(x,p, q) = H(x,p) + g, we observe that the vector (n(x), 0) is the unit outer 
normal at (x,t) G dCl, the conditions (Al)-(A7) are satisfied with B and f2 in 
place of B and Q and the Lagrangian L of H is given by 

L(x,£,v)= sup (p-^ + qrj- H(x,p)) = L(x,£) + 6 {1 y(r]), (3.15) 

(p,<j)gM"+ 1 

where is the indicator function of the set {1}, i.e, 6{i}(rj) = if 77 = 1 and 
= 00 if 7/ 7^ 1. If we set for (x, t) G dCl, 

Q(x,t) = {(7,5, g) G R"xlxl : B(x,p,q) > ~f-p + 5q-g for (p, g) G 

then it is easily seen that Q(x, t) = {(7, 1,^) : (7,^) G G(x)}. 

The Skorokhod problem for Cl and i? is to find for given (x, t) G f2 , T > 
and G L x ([0, T],M n+1 ) a pair of functions (r), r) G AC([0 1 T],M n+1 ) and 

/ G ^([0, T],R) such that (77(0), r(0)) = (x,t), (t)(s),t(s)) G Q for s G [0, T], 
/(s) > for a.e. s G [0, T], Z(s) = if (77(5), r(s)) G Q for a.e. s G [0, T], and 
((f — r))(s), (w — f)(s), f(s)) G l(s)Q(r)(s), t(s)) for a.e. s G [0, T] and for some 

/ G -^ 1 ([0, T],R). It is easily checked that for given (x, t) G , T > and 
(v,w) G L^fO, T],M n+1 ), the pair of functions (77, r) G AC([0, T],M n+1 ) and 
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/ G -^ 1 ([0, T], R) is a solution of the Skorokhod problem for Cl and B if and only 
if (rj, v, I) E SP T (x) and r(s) = t - J s (w(r) + Z(r)) dr for all s E [0, T]. If we 
take into account of the form (3.15), then we need to consider the Skorokhod 
problem only with w(s) = 1. That is, in our minimization at (x, t) E Q, we 
have only to consider the infimum all over (rj,v,l) G SP(x) and r such that 
t(s) = t — J Q S (1 + l{r)) dr for s > 0. Note that this function r is decreasing on 
[0, 00) and that r(s) = if and only if t = Jq(1 + l(r)) dr, which justifies the 
choice of a in (3.14). 

We have the following theorems concerning (DBC). 

Theorem 3.5. The function W is a solution of (DBC) and continuous on Q. 
Moreover, if Uq G Lip (Cl), then W G Lip (Q). 

In the above theorem, the subsolution (resp., supersolution) property of 
(DBC) assumes as well the inequality u(-, 0) < uo (resp., v(-, 0) > uq) on dfl. 

We do not give here the proof of the above theorem, since one can easily 
adapt the proof of Theorems 3.2, using theorems 1.1 and 1.2, with minor 
modifications. A typical modification is the following: in the proof of the 
viscosity property of W, we have to replace the cures (r)(s),t — s), with s > 0, 
which are used in the proof of Theorem 3.2, by the curves (t)(s), t(s)), with 
s > 0, where r(s) := t — J Q S (1 + l(r)) dr. 

A further remark on the modifications of the proof is the use of the following 
lemma in place of [22, Lemma 5.5]. 

Lemma 3.6. Let t > 0, x G Cl, ip G C(Cl x [0, t], W 1 ) and e > 0. Then there 
is a triple (r),v,l) G SP(x) such that for a.e. s G (0, t), 

H(r](s),i/;(r)(s),T(s))) + L(r](s), -v(s)) < s - v(s) -ip(v(s), r(s)), 

where r(s) := t — + l{r)) dr and i/j(x, s) := ijj{ x i 0) f or s < 0. 

The above lemma can be proved in a parallel fashion as in the proof of [22, 
Lemma 5.5], and we leave it to the reader to prove the lemma. 

3.2. Extremal curves or optimal controls. In this section we establish 
the existence of extremal curves (or optimal controls) (77, v, I) G SP for the 
variational formula (3.5). We set Q = Cl x (0, 00). 

Theorem 3.7. Let uq G Lip (Cl) and let u G Lip (Q) be the unique solution of 
(CN). Let (x,t) G Q. Then there exists a triple (n, v, I) G SP t (x) such that 

u(x,t)= [ (L(n(s), -v(s)) + f(s))ds + u (r l (t)), 
Jo 

where f = F(n,vJ). Moreover, rj G Lip([0, t],R n ) and (v, I J) G L°°([0, t],M n+2 ). 

Proof. Fix (x,t) G Cl. In view of formula (3.5), we may choose a sequence 
{(Vk, Vf., h)} C SPi(x) such that for k EN, 

1 f* 

u(x,t) + -> J (L(r] k (s),-v k {s)) + f k (s))ds + u (r} k (t)), (3.16) 
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where f k := F(rj k ,v k ,l k ). 

We show that the sequence {v k } is uniformly integrable on [0, t]. Once this 
is done, due to Lemma 3.4, the sequences {rjk} and {l k } are also uniformly 
integrable on [0, t}. If we choose a constant C > so that C > max^ B(x, 0), 
then G(x,£) > —C for all (x,£) G dQ x R n and hence, f k (s) > —C l k (s) for 
a.e. s G [0, t}. Due to Lemma 3.4, there is a constant Ci > 0, independent 
of k, such that f k (s) > —C\\v k (s)\ for a.e. s G [0, t], which implies that 
|/fe( s )| < fk(s) + 2Ci\v k (s)\ for a.e. s G [0, £]. Since H is coercive, for each 
A > there exists a constant C(A) > such that L(x,£) > - C(A) for 
all (i,()eflx M n . Combining these two estimates, we get for all A > 0, 

+ \fk{s)\ < L( Vk (s), -v k (s)) + f k (s) + C(2d + A). (3.17) 

We fix any A > and measurable C [0, t], and, using the above estimate 
with A = and A = A, observe that 



(L( Vk (s), -v k (s)) + f k (s) + C(d)) ds 

< / (L(r/ fc (s), -^( S )) + / fe ( S ) + C(C 1 ))ds 

■/ o 

< u(x, t) - %(%(£)) + - + C(Ci)t, 

and hence, 

a/ |u fc (5)|ds< /'( J L( % ( S ),-^( S )) + / fc ( S ))d S + C(2C 1 + A)|£;| 



< 2 max lul + 1 + C(d)t + C(2d + A)\E\, 

Qx[0,t] 

where \E\ denotes the Lebesgue measure of E. From this, we easily deduce 
that {v k } is uniformly integrable on [0, t}. Thus, the sequences {fj k }, {v k } and 
{l k } are uniformly integrable on [0, t]. 

Next, we show that {f k } is uniformly integrable on [0, t}. To this end, we 
fix two finite sequences {cxj} and {(3j} so that 

< CKl < fa < a 2 < < ■ ■ ■ < Oi m < fim < t. 

Set /3o = and a m+ i = t. In view of the dynamic programming principle, we 
have for j = 0, 1, 2, m, 

raj+i 

u(Vk(Pj),t ~ Pf) < u(rj k (a j+1 ),t - a j+1 ) + / (L(r) k (s), -v k (s)) + f k (s)) ds. 
Subtracting these from (3.16) yields 

^ m m 

3=1 3=1 

(3.18) 



a 3\ 



fPi 

+ J2 (HVk{s), -v k (s)) + f k (s)) ds. 

3=1 Ja > 
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Hence, if K > is a Lipschitz bound of u, then we get 

3=1 Ja i 3=1 

Now, using (3.17) with A = 0, we find that 

E / l/^)|ds<r + E/ W^I + ^ + ^d^ds, 

from which we infer that is uniformly integrable on [0, t}. 

We apply the Dunford-Pettis theorem to the sequence {(r) k , v k , h, /fc)}, to 
find an increasing sequence {kj} C N and functions /i, u G L 1 ([0, t], M n ), 
/, / G ^([0, t],R) such that, as j ->■ oo, (ry fcj ■, % , 4 ; , .7% ■) -> (/i, u, /) weakly 
in Z^QO, t],M 2n+2 ). Setting r](s) = x + f*h(r)dr for s G [0, t], we have 
rjkj( s ) ~ > v{ s ) uniformly on [0, t] as j — >■ oo. Then, as in the last half of the 
proof of [22, Lemma 7.1], we infer that 

/ L(r](s), -v(s))ds < liminf / L(% (a), -v fc (s)) ds. 
Jo Jo 

It is now obvious that 

u(x,t)> [ (L(r)(s),-v(s)) + f(s))ds + u (v(t)). (3.19) 
Jo 

Now, we show that (r),v,l) G SP t (x). It is clear that 77(5) G for all 
s G [0, rj] and l(s) > for a.e. s G [0, t]. It is thus enough to show that 
(v(s) - T)(s), f(s)) G l{s)G{r){s)) for a.e. s G [0, t]. Setting £ fc := v k - f) k and 
£ := f — 77 on [0, i], we have 

l k (s)B(r} k (s), p) > £ fe (s) • p - / fe (s) for all p G M n and a.e. s G [0, i], 

Let <p G C([0, t],R) satisfy <p{s) > for all s G [0, t]. We have 

/ <P{s) {l k {s)B{ Vk {s), p) - £ k {s) ■ p + f k {s)) ds > for all p G M n . 
Jo 

Sending — )■ 00 along the subsequence k = kj, we find that 

/ 0(s)(/(s) J B(r?(s),p)-^(s)-p + /(s)) ds>0 for p G M n . 
Jo 

This implies that (£(s), /(s)) G /(s)^(?7(s)) for a.e. s G [0, £], and conclude 
that (77, v, I) G SPf(x). 

Next, we set f(s) = F(r],v,l)(s) for s G [0, t}. Since (u(s) — v( s )i f( s )) e 
K s )S(v{ s )) f° r a - e - s e [0) we see that /(s) < /(s) for a.e. s G [0, t] and 
/ G #([0, t],R). Using (3.19) and (3.5), we get 

u(z,i)> / {L(r)(s),-v(s)) + f(s))ds + u (v(t)) 
Jo 

> / (L(»7(s),-«(s)) + /(a))ds + uo(»7(t)) >u(x,t). 
Jo 
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Therefore, we have f(s) = f(s) for a.e. s G [0, t] and 

u(x,t) = [ (L(r](s),-v(s)) + f(s))ds + u Q (rj(t)). 
Jo 

Finally, we check the regularity of the triple (r],v,l) G SPt(x) and the func- 
tion /. Fix any interval [a, (3] C [0, t], and observe as in (3.18) that 

(L(rj(s), -v(s)) + f(s)) ds < u(r}(/3),t -(3)- u(rj(a),t - a) 



<K \rj(s)\ds + K(P-a) 

J a 



Here we may choose a constant C3 > so that \fj(s)\ < C 3 \vk(s)\ for a.e. 
s G [0, t]. Combining the above and (3.16), with (rj, v, f) in place of (rjk, v k , fk) 
and A = KC 3 + 1, and setting C 4 = C(2Ci + KC 3 + 1), we get 

(\v(s)\ + \f(8)\)d8<(K + Ct)(P-a), 



from which we conclude that (v, f) G L°°([0, t], M. n+1 ) as well as (rj,l) G 
L°°([0, t],R n+1 ). □ 

An immediate consequence of the previous theorem is the following. 

Theorem 3.8. Let (p G Lip (0) be a solution of (El), with a = 0. Let x G Cl. 

Then there is a triple (77, v, 1) G SP(x) such that for any t > 0, 

<P(x) - <P( V (t)) = f (L( V (s), -v(s)) + f(s)) ds, (3.20) 
Jo 

where f := F(rj, v, I). Moreover, r\ G Lip ([0, 00), M") and (v, I, f) G L°°([0, 00),'. 

Proof. Note that the function u(x,t) := 4>(x) is a solution of (CN). Using 
Theorem 3.7, we define inductively the sequence {{rjk, Vk, h)}k>o C SP as 
follows. We first choose a (770, vq, lo) G SP(x) so that 

0MO))-^M1))= / {L(r)o(s),-v (s)) + F(r) ,v ,l )(s))ds. 

Jo 

Next, we assume that {(rjk, v k , h)}k<j-i, with j > 1, is given, and choose a 
(rjj, Vj, lj) G SP(r?j_ 1 (l)) so that 

<?%(!)) - 0(^(0)) = / (L(r /j ( S ),-^( S )) + F(r /j ,^,/ J )( S ))d S . 



Once the sequence {(rjk, Vk, h)}k>o C SP is given, we define the (77, v, I) G 
SP(cc) and the function / on [0, 00) by setting for k G N U {0} and s G [0, 1), 

(r/(s + k), v k (s + k), l(s + k), f(s + k)) = (rj k (s), v k (s), l k (s), F(ri k ,v k ,l k )(s)). 

It is clear that (rj, v, I) G SP(x), / = -F(?7, v, I) and (3.20) is satisfied. Thanks to 
Theorem 3.7, we have rj k G Lip([0, l],M n ) and (v k , l k , f k ) G L°°([0, 1],M™ +2 ) 
for k > 0. Moreover, in view of the proof of Theorem 3.7, we see easily 
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that sup fc>0 \\(vk, /fc)|U°°([o, i]) < oo, from which we conclude that (77, v, I, f) G 
Lip([0, 00), W 1 ) x L°°([0, oo),M n+2 ). □ 

3.3. Derivatives of subsolutions along curves. Throughout this section 
we fix a subsolution u G USC (Q) of (El) with a = 0, 0<T<oo and a 
Lipschitz curve rj in Q, i.e., rj G Lip ([0, T], M n ) and rj([0, T]) C f2. 

Henceforth in this section we assume that there is a bounded, open neighbor- 
hood V of dQ for which H, B and n are defined and continuous on (QUV) xl", 
^xK™ and V, respectively. Moreover, we assume by replacing 9 and Mb in 
(A3), (A4) respectively by other positive numbers if needed that (Al), with V 
in place of Q, and (A3)-(A5), with V in place of dQ, are satisfied. (Of course, 
these are not real additional assumptions.) 

Theorem 3.9. There exists a function p G L°°([0, T],M n ) such that for a.e. 
t G [0, T], f t u o v (t) = p(t) ■ fi(t), H( V (t),p(t)) < 0, and B( V (t),p(t)) < 
ifr](t) G dQ. 

To prove the above theorem, we use the following lemmas. 

Lemma 3.10. Letw G Lip(fi), {w £ } £>0 C Lip(fi) and{p e } £>0 C L°°([0, T],M r 
Assume that w £ (x) — > w(x) uniformly on fl as e — > and, /or a.e. t G [0, T], 

-^W £ o ^(t) = p B (t) ■ f](t), H(f](t), p £ (t)) < 8, 

B( V (t), p £ (t)) < e if V (t) G dQ. 



then there exists a function p G L°°([0, T],IR n ) such that for a.e. t G [0, T] 

_d 

dt 

Proof. Observe first that for all t G [0, T] 



d wor)(t) =p(t)-fj(t), H(r){t), p(t)) < 0, and B(r/(t), p(t)) < z/r/(t) G <9^. 



w(r](t)) - w(r](Q)) - / p e (s) ■ 7)(s) ds 



< 2\\w £ - w\\ L oo(ny 

Next, we observe by the coercivity of H that {p £ } is bounded in L°° ( [0, T] , M n ) 
and then, in view of the Banach-Sack theorem, we may choose a sequence 
{Pj}je~N and a function p G L°°([0, T],R n ) so that Pj is in the closed convex 
hull of {p £ : < e < l/j}, Pj -> p strongly in L 2 ([0, T],IR n ) as j ->■ 00 
and Pj(t) — )■ p(t) for a.e. t G [0, T] as j — > 00. By (3.21) and the convexity 
of H and B, we see that, for a.e. t G [0, T], H(rj(t), Pj(t)) < and 
£(77 (t), Pi(t)) < J" 1 if v(t) e Moreover, we have, for all t G [0, T], 



w (v(t)) - w(rj(0)) - I pj(s) ■ r)(s) ds <2 sup \\w e - w\\ L <x,(n). 

0<£<j- 1 







Now, by sending j — > 00, we get for a.e. t G [0, T], H(rj(t), pit)) < 0, and 
B(r](t), p(t)) < if /?(*) G dQ, and, for all t G [0, T], «;(?;(*)) - w(r](0)) = 
JqP(s) ■ f](s) ds. The proof is complete. □ 

Lemma 3.11. Let z G dQ and e > 0. Then there are an open neighborhood 
U of z in Cl, a sequence {Vj}j £ fq of open neighborhoods ofUCl dQ in V and a 
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sequence {uj}j^ of C 1 functions on Wj :— U U Vj, such that for each j the 
function Uj satisfies 

( H(x,Duj(x)) <e in Wj, 
| B(x, Duj(x)) < e inVj, 

and, as j — » oo, Uj(x) — > u(x) uniformly on U. 

We now prove Theorem 3.9 by assuming Lemma 3.11, the proof of which 
will be given after the proof of Theorem 3.9. 

Proof of Theorem 3.9. In view of Lemma 3.10, it is enough to show that for 
each s > there exists a function p e G L°°([0, T],IR n ) such that for a.e. 
t G [0, T], f t u o v (t) = p £ (t) ■ fj(t), H(rj(t), p £ (t)) < e, and B( V (t), p £ (t)) < e 
if r)(t) G dQ. To show this, we fix any e > 0. It is sufficient to prove that for 
each r G [0, T], there exist a neighborhood I T of r, relative to [0, T], and a 
function p T G L°°(I T , R") such that for a.e. t G I T , -4m o ?7(t) = p r (t) • r)(i), 
^(r/(t), p T (t)) < e, and p T (t)) < e if G <9fi. 

Fix any r G [0, T]. Consider first the case where t](t) G f2. There is a 5 > 
such that r](I T ) C fi, where I T := [r — 5, r + 5] fl [0, T]. We may choose an 
open neighborhood U of z such that ?7(/ r ) C U d fi. By the mollification 
technique, for any a > 0, we may choose a function M a G C 1 (f/) such that 
H(x, Du a (x)) < e and \u a {x) — u(x)\ < a for all x G U. Then, setting 
Pr,a(t) = Du a (r)(t)) for t G J T and a > 0, we have o 77 (t) = p T , a (t) • f)(t) 

and H(rj(t),p Tt a(t)) < e for a.e. t £ I T and all a > 0. Hence, by Lemma 
3.10, we find that there is a function p T G L°°(I T , MJ 1 ) such that for a.e. t G J r , 
f t uor)(t)=p T (t)-f)(t) and H( V (t),p T (t)) < e. 

Next consider the case where r^(r) G <9f2. Thanks to Lemma 3.11, there are 
an open neighborhood U of t/(t) in 0, a sequence {Vj}j e ^ of open neighbor- 
hoods of U fl 9fi in V and a sequence {uj}j £ ^ of C 1 functions on Wj := C/ U Vj 
such that for any j G N, H(x, Duj(x)) < e for all x G Wj, B(x, Duj(x)) < e 
for all x & Vj and |wy(a;) — u(x) \ < 1/j for all x E U. We now choose a constant 
<5 > so that if I T := [r-5, r+5]n[0, T], then r/(J r ) C Z7. Set pj(t) = Duj(rj(t)) 
for t G J r . Then, for a.e. t G [0, T], we have -jkuj o r)(t) = Pj(t) ■ rj(t), 
H(rj(t), Pj(t)) < e, and B(r](t), Pj(t)) < e if ?7(t) G <9f2. Lemma 3.10 now 
ensures that there exists a function p T G L°°(J r ,]R n ) such that for a.e. t G I T , 
f t u o r/(t) = p T (t) ■ f)(t), H(r)(t), p T (t)) < e, and B{rj{t), p T (t)) < e if 
r)(t) G dfl. The proof is now complete. □ 

For the proof of Lemma 3.11, we need the following lemma. 

Lemma 3.12. Let w G Lip (f2) be a subsolution of (El), with a = 0. Let 
z G dQ andp G D + w(z). Assume that p + tn(z) ^ D + w(z) for allt > 0. Then 

p e n u ^m^)- 

r>o £•££,. (z)nn 
In particular, we have H{z, p) < 0. 
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Proof. We choose a fucntion <fi G C 1 (Q) so that D(j>(z) = p and the function 
w — <p attains a strict maximum at z. Let ip G C 1 (M n ) be a function such 
that Q = {x G R n : i){x) < 0} and Dip(x) ^ for all x G dQ. For e > 0, 
let x e G be a maximum point of the fucntion $ := w — — eip on f2. It is 
obvious that i e -> z as e 0+ and D((f> + eip)(x £ ) G D + w(x £ ). Suppose that 
x e = z. Then we have D<p(z) + e\Dip(z)\n(z) G -D + u>(;2:), which is impossible 
by the choice of p. That is, we have x £ ^ z. Observe that for any x G dQ, 
— (w — <fi)(x) < (w — <p){z) = &{z) < $(x e ), which guarantees that 
x £ G Q. Thus we have p = lim £ ^ 0+ D((j) + eifj)(x £ ) G U r>0 fUnniM*) D + w(x), 
which implies that H(z, p) < 0. □ 

Proof of Lemma 3.11. We fix any < e < 1 and 2; G <9f2. Since f2 is a C 1 
domain, we may assume after a change of variables if necessary that z = and 
for some constant r > 0, 



Of course, we have n(x) = n(z) = e n for all x G B r fl <9f2. 

Now, we choose a constant K > so that for (a:,p) G fix R n , if H(x, p) < 0, 
then \p\ < K. We next choose a constant i? > so that \B(x,p) — B(z,p)\ < e 
for all (x,p) G (dQ fl 5^) x S^. Replacing r by i? if r > _R, we may assume 
that r < R. 

We now show that u is a subsolution of 



To do this, we fix any x G B r fl Cl and p G D + u(x). We need to consider only 
the case when x G dQ. We may assume that H(x, p) > 0. Otherwise, we have 
nothing to prove. We set r := sup{t > : p + tn(x) G -D + ii(x)}. Note that 
B(x,p) < and, therefore, r > 0. Since the function t 1— > B(x, p + th(x)) — 9t 
is non- decreasing on IR, we see that B(x, p + tn(x)) > for all t large enough. 
Also, it is obvious that H (x, p+tn(x)) > for all t large enough. Therefore, we 
see that p + th(x) ^ D + u(x) if t is large enough and conclude that < r < 00. 

Since D + u(x) is a closed subset of W 1 , we see that p + rn(x) G D + u(x). 
From the definition of r, we observe that p + G" -D + w(a;) for t > r. We 

now invoke Lemma 3.12, to find that H(x, p + rn(x)) < 0. 

We recall the standard observation that if q G D + u(x), then g — tn(x) G 
D + u(x) for all t > 0. Hence, we must have either H(x, p + tn(x)) < or 
B(x, p + tn(x)) < for any t < r. Set a := sup{t G [0, r] : p + tn(x)) > 

0}, and observe that < a < t and H(x, p + o~h(x)) < 0. There is a sequence 
{t,-} C [0, t] converging to <r such that H(x, p + tjh(x)) > 0, which implies 
that B(x, p + tjh(x)) < 0. Hence we have B(x, p + an(x)) < 0. Thus we 
have a > 0, H(x, p + ah(x)) < and B(x, p + ah(x)) < 0. By the choice of 
K, we have p + em(;2) G B K , and hence _B(z, p + ah(x))) < e. Noting that 
h(x) = n(z) and o > 0, we see by the monotonicity of t 1 — ?• B(z, p + tn(z)) 
that p) < e. Thus we find that u is a subsolution of (3.22). 



B r H Q = {x = (xi, x n ) <E B r : x n < 0}. 



-Du(x)) < mB r HQ, 
B(z,Du(x))<e onB r ndQ. 



(3.22) 
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Following the arguments of Lemma 4.3, we can show that there exist a 
function ( G C 1 (M n ) n Lip (R n ) and a constant 5 > such that for all f G R n , 
((£)>(K+1)\Z\ and 



> -e if ^ > -5, 
<e if £ n < 5. 



We may also assume that £ G C°°(M n ) and all the derivatives of ( are bounded 
on R n . 

We introduce the sup-convolution of u as follows: 

u a (x) : = max - <*£(—)) for x G M n , 

where a > 0. We write Cq(0 f° r Q; C(C/ a ) f° r convenience, and note that 
B(z, D(a(0) > 2e if £ n > -a6 and B(z, D( a (0) < ^ if 6n < Set 
£/ = B r/2 f] {x E W 1 : x„ < 0}, V a = {x E B r/2 : < 5a 2 } and 

Wq, := {x G -B r /2 : x n < 5a 2 }. Note that C/ is an open neighborhood of 
z = relative to Cl, V a is a open neighborhood of C D <9fi and W Q = U U V^. 
We choose an < a < 1 so that V a C V for all < a < a , and assume 
henceforth that < a < a$. 

We now prove that if a is small enough, then u a satisfies in the viscosity 
sense 

H(x, Du a (x)) < e in W a , 
B(z, Du a (x)) < Ae in V a . 

To this end, we fix any x G W a and p G D + u a (x). Choose y G B r H Q so 
that Uq,(x) = u(y) — ( a (y — x). It is a standard observation that if y G B r , 
then DCaijj — x) = p G D + u(y). 

Next, let re denote the projection of x on the half space {i6l™ : x n < 0}. 
That is, x = x if x„ < and x = (x±, x n _i, 0) otherwise. We note that 
|x — £| < <5a 2 < 5a < 5 and — ( a (x — x) < u a (x) = u{y) — ( a (y — x). 

Hence, 

u(y) - u(x) > Ca{y - x) - ( a (x - x) > (K + 1) \y - x\ - a sup 

and furthermore, (K+l)\y—x\ < K\x— y\ +Ra, where R := KS+s\ip^ B C(0- 
Accordingly, we get \y — x\ < Ra. We may assume that Rao < r/2, so that 
V G B r . 

If y„ < 0, then y G Q and we have H(y,p) < 0. Moreover, writing a;^ for 
the modulus of H on (B r n fi) x B^, we get H(x,p) < H(y,p) + u)h(Roc) < 
ojh{Rch). We may assume by reselecting ao by a smaller positive number that 
cjh(Roc) < e. Thus we have H(x, p) < e. 

Next, assume that y n = 0. We have y n — x n > 0, and hence, B(z, D( a (y — 

x)) > 2e. Since \x — x\ < 5a 2 , we find that \D( a (y — x) — DQ a (y — x)\ < 
c \x-x\ < C6 d 

L>C Q (y - x)) > B(z, D( a (y - x)) - M B C5a) > 2e - M B C5a, 
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where C > is a Lipschitz bound of D(. We may assume by replacing a 
by a smaller positive number if needed that MsCba < e. Then we have 
B(z, p) = B(z, D( a (y — x)) > e, and therefore, H(y,p) < 0. As before, we 
get H(x,p) < ujh(Rq) < e . Thus we conclude that if < a < a , then 
H(x, Du a (x)) < e is satisfied in W a in the viscosity sense. 

Next, we assume that x G V a . Since y n < 0, we have y n — x n < 5a 2 < 5a 
and B(z, p) = B(z, D( a (y — x)) < 4e. Thus, u a satisfies B(z, Du a (x)) < 4e 
in V a in the viscosity sense. 

Since H(x, Du a (x)) < e in W a in the viscosity sense, the functions u a on W a , 
with < a < «o, have a common Lipschitz bound. Therefore, by replacing r a 
smaller positive number if necessary, we may assume that for any < a < a^, 
B(x, Du a (x)) < 5e in V a in the viscosity sense. 

Finally, we fix j e N and choose an aj G (0, a ) so that \u aj (x) — u(x)\ < 1/j 
for all x G U. By mollifying u aj , we may find a function Uj G C 1 (|W / aj ) such 
that \uj(x) — u(x)\ < 2/j for all x G |t/, H(x, Duj(x)) < 2e for all 
x G |Wq. and B(x, Duj(x)) < 6e for all x G The collection of the 

open subset \U of 0, the sequence {^V aj }j e ^ of neighborhoods of 9f2 D \U 
and the sequence {uj}j e j$ of functions gives us what we needed. □ 

Lemma 3.13 (A convexity lemma). Let {u\}xeA C C(fi x (0, oo)) be a 
nonempty collection of subsolutions of (3.6), (3.7). Setu(x,t) = mi\ e \U\(x,t) 
for (x, t) G Cl x (0, oo). Assume that u is a real-valued function onClx (0, oo). 
T/ien u is a subsolution of (3.6), (3.7). 

Proof. Set Q = x (0, oo). Fix (x,t) G Q and G C 1 (<5), and assume that 
u — <p attains a strict maximum at (x,t). We may assume that has the 
form: <f)(x,t) = ip(x) + x{t) for some functions ip and Fi x an y £ > 0. By 
Lemma 3.3, there exists (7, g) G C(<9f2, M n+1 ) such that (7(x), (?(x)) G <?(x) 
and i?(x, Dtp(x)) < e + 7(2) • Dtp(x) — g(x) for all x G <9f2. By this first 
condition, we see that the functions u\, with A G A, are subsolutions of 

u t (x, t) + H(x, Du(x, t)) = in Q, 

(3.23) 

7(x) ■ Du(x, t) = g(x) on <9£7 x (0, 00). 

By [22, Theorem 2.8], we find that a is a subsolution of (3.23), which implies 
that either Xtif) + H{x,Dijj{x)) < 0, or x G <9f2 and 7(2:) • Dip(x) — g(x) < 
0. But, this last inequality guarantees that B(x, Dip(x)) < e. Since e > 
is arbitrary, we see that either Xt{t) + H(x, Dijj(x)) < 0, or x G 9fi and 
£>(x, Dtp(x)) < 0. Hence, u is a subsolution of (3.6), (3.7). □ 

The above proof reduces the nonlinear boundary condition to the case of a 
family of linear Neumann conditions. One can prove the above lemma without 
such a linearization procedure by treating directly the nonlinear condition and 
using Lemma 3.11 as in the proof of [22, Theorem 2.8]. 

It is worthwhile to noticing that another convexity lemma is valid. That is, 
if u and v are subsolutions of (3.6), (3.7), then so is the function \u + (1 — X)v, 
with < A < 1. 
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Note that the propositions, corresponding to this convexity lemma and 
Lemma 3.13, are valid for (DBC). 

3.4. Convergence to asymptotic solutions. In this section, we give the 
second proof of Theorem 1.5 for (CN). We write Q = fl x (0, oo) throughout 
this section. 

We define the function on fl by 

^oo(^) = inf{0(x) : <p G Lip (fl), is a solution of (El) with 

a = 0, <p > Uq on fl}, (3.24) 

where Uq is the function on fl given by 

Uq (x) = sup{^(x) : if) G Lip (fl), ip is a subsolution of (El) with 

a = 0, ijj < Uq on fl}. 

It is a standard observation that uq and Lipschitz continuous functions 

on fl and are, respectively, a subsolution and a supersolution of (El), with 
a = 0. Moreover, using Lemma 3.13, we see that solution of (El), with 

a = 0. 

Lemma 3.14. We have u^lx) = liminf^oo u(x, t) for all x G Cl. 

For the proof of this lemma, we refer to the proof of [23, Proposition 4.4], 
which can be easily adapted to the present situation, and we skip it here. 

Proof of Theorem 1.5. We show that 

lim u(x,t) = Uooi^x) uniformly for i G 0. (3.25) 

t— >oo 

Therefore, in order to prove (3.25), it is enough to show the pointwise con- 
vergence in (3.25). Moreover, by Lemma 3.14, we need only to show that 

limsup u(x, t) < Uoq^x) for all x G fl. 

t— >oo 

Now, we fix any x G fl. Since Uoo is a solution of (El), with a = 0, by 
Theorem 3.8, there is an extremal triple (rj,v,l) G SP(x) such that, if we set 
/ = F(r], v, I), then we have 

«oo(»7(0))-Uoo(»7(*))= / {L{t]{s),-v{s)) + f{s))ds for all* >0, 

Jo 

which is equivalent to the condition that — -^«oo ° = L(r](t), —v(t)) + 
f(t) for a.e. t > 0. Moreover, we have i), v G £°°([0, oo),lR n ) and I, f G 
L°°([0, oo),M). By Theorem 3.9, there exists a function p G L°°([0, oo),R n ) 
such that for a.e. t G [0, oo), -^-Woo ° v(t) = p(t) ' v(t)i H(r](t), p{t)) < and 
B(rj(t), p(t)) < if rj(t) G dfl. Observe that l(t)B(r](t), p(t)) > (v - f])(t) ■ 
p(t) - f(t) for a.e. t G [0, oo). 
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Next, combining the above relations together with the Fenchel- Young in- 
equality, — w ■ q < H(y, q) + L(y, —w), we observe that if we set £ = v — f), 
then for a.e. t > 0, 

—£Uoo(rt(t)) = -pit) ■ f](t) = -pit) ■ (v(t) - £(*)) 

< H( v (t), p{t)) + Li-nit), -v(t)) + pit) ■ m 
<L(n(t), -vit))+ P it)-^t) 

< L( v (t), - v (t)) + i(t)B( v (t), pit)) + fit) 

< L( V (t), -v(t)) + fit) = -± Uoo (ri{t)). 

Thus, all the inequalities above are indeed equalities. In particular, we find 
that -v(t) ■ pit) = H(n(t), pit)) + L(n(t), -v(t)) = L(n(t), -v(t)) for a.e. 
t > 0, which shows that pit)) = and — v(t) G <9 p iJ(?7(t), pit)) for a.e. 

t > 0. 

We here consider only the case when (A7) + is valid. It is left to the reader 
to check the other case when (A7)_ holds. 

The argument outlined below is parallel to the last half of the proof of [23, 
Theorem 1.3]. Since (A7)+ is assumed, there exist a constant 5q > and a 
function ujq G C([0, oo)) satisfying CJo(O) = such that for any < 5 < 5q and 
(y, z) eQ x R n , if H(y, q) = and z G d p Hiy, q) for some q G M n , then 

L(y, (l + 6)z)<(l + 6)L(y, z) + 6u Q i6). 

This ensures that for a.e. t > and all < 5 < 5q, 

L(n(t), -(1 + S)v(t)) < (1 + 5)L(n(t), -v(t)) + 5uq{5). (3.26) 

We fix e > 0, and note (see for instance the proof of [23, Theorem 1.3]) that 
there is a positive constant T and, for each y G 0, a constant < T(y) < T 
such that uiy, T(y)) < u^iy) + e. 

We choose t > T so that T / (t — T ) < 5 . Fix any t > t , and set y = 7/(t), 
T = T(y), S = t - T and 5 = (t - S)/S. Note that 5 = T/(t — T) < 5 and 
5 -»■ as t -»■ oo. We set 7fo(t) = r/((l + 5)t), u 4 (t) = (l + <J)v((l + <J)t), Z 5 (t) = 
(1 + 5)l((l + 5)t) and f s (t) = (1 + + 5)t) for t > 0. Using (3.26) and 

noting that (1 + S)S = t and 5S = T < T , we get 

/ L(r)s(s) : -vs(s))ds < / L(r)(s), -v(s)) ds + T u (5). 
Jo Jo 

Hence, noting that (rj8,vs,ls) G SP(x) and fs = F(rjs,vs,ls) an d using the 
dynamic programming principle, we find that 

u{x,t)< [ (L{r) 6 {s),-v 5 {s)) + f s {s))ds + u{n s {S),t-S) 
Jo 

= [ (L( V (s),-v(s)) + f(s))ds + ecu (5)+u(y,T) 
Jo 

<Moo(x) +T UJ iS) +s, 
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which implies that limsup^^ u(x, t) < u^x). The proof is now complete. □ 

Finally we briefly sketch some arguments in order to explain how to adapt 
the dynamical approach to Theorem 1.5 for (CN) to that of Theorem 1.5 for 
(DBC). As usual, we assume that c* = and let Uoo be the same function 
as in (3.24). We infer that liminft_ ) . ao u(x, t) = Uoo(x) for all x G Cl. To 
prove the inequality limsup^^ u(x, t) < Uoo(x) for x G Cl, we fix x G fl and 
e > 0, and select a triple (r),v,l) G SP(x), a constant T > and a family 
{T(y)} ye n C (0, T ] as in the dynamical approach. 

We fix t > and introduce the function r on [0, oo) given by r(s) = t—f*(l + 
Z(r)) dr. Define the constant a G (0, t) by r(a) = 0. Since / G L°°([0, oo),M), 
we have a — > oo as t — > oo. We set y = rj(a), T = T(y), S = a — T 
and 5 = (a — S)/S. We note that SS = a — S = T and that, as t — > oo, 
S = a — T — > oo and 5 = T/S 1 0. We assume henceforth that t is large 
enough so that 5 < 5 . 

We define rjg, Vg, h and f$ as in the dynamical approach for (CN). We define 
the function Tg on [0, oo) by Tg(s) = t — J^(l + lg(r)) dr for s > 0. It is easily 
seen that Ts(S) = T. Then we compute similarly that 



from which we conclude that limsup^^ u(x, t) < Uoo(x) for all iGfl. 

3.5. A formula for u^. Once the additive eigenvalues of (El) and (E2) are 
normalized so that c = 0, the correspondence between the initial data uq and 
the asymptotic solution is the same for both (CN) and (DBC). 

We assume that c = 0, and present in this section another formula for the 
function given by (3.24). 

We introduce the Aubry (or, Aubry-Mather) set A for (El), with a = 0. We 
first define the function d G Lip (Q x Q) by 

d(x,y) = ini{ip(x) — ijj{y) : ip is a subsolution of (El), with a = 0}, 

and then the Aubry (or, Aubry-Mather) set A for (El), with a = 0, as the 
subset of consisting of those points y where the function d(-, y) is a solution 
of (El), with a = 0. 

Theorem 3.15. The function given by (3.24) is represented as 
Uoc{x) = inf{d(x, y) + d(y, z) + u (z) : z G Q, y G A}. 




where u G C([0, oo)) is a function satisfying u (0) = 0, and 




< / (L( V (s),-v(s)) + f(s))ds + T cu (5)+u(r)(a),T) 



{L{r]s{ S ), -vs(s)) + f s (s)) ds + u(rj s (S), r s (S)) 



<Uoo(x) + T u (5) + e, 
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The function Uq has the formula similar to the above: Uq (x) = inf {d(x, y) + 
uo(y) : y G Accordingly, we have u^x) = ini{d(x, y) + Uq (y) : y G .A}. 

We do not give the proof of these formulas, and instead we refer the reader 
to [23, Proposition 4.4] and [5, Proposition 6.3] where these formulas are es- 
tablished for (El) with the linear Neumann condition. 

4. Appendix 

4.1. Construction of test-functions. In order to prove Theorem 1.1, we 
have to build test-functions. For the convenience of the reader, we briefly recall 
how to construct these functions and refer to [1, 2, 3, 20] for more general cases 
as well as more details. 

Lemma 4.1. There exists M\ > such that for any 5 G (0, 1) and £ G dfl, 
there exists a function C^' s G C 1 (IR n+1 ) such that 

\q + B(C,P + C^(p iq )n(0)\<m(S), 
\D p C^(p,q)\ + \D q C^(p,q)\ < Mi and 

D q C^ 5 (p,q)<0 

for any (p, g) G 1" x R, where m is a modulus. 

Proof By (A2) and (A3) there exists a function C ? G C(R n x R) such that 

q + B(£,p + Ct(p,q)n(t))=0, 

\C*(pi,qi) ~ C^p 2 ,q 2 )\ < M 1 (\ Pl -p 2 \ + \ gi - q 2 \) 

for some M\ > 0. Noting that r H- B(^,p + rn(£)) is increasing, we see that 
q C^(p, q) is decreasing for any p G IR n . Therefore we see that a regularized 
function C^' S by a mollification kernel satisfies the desired properties. □ 

Similarly we can prove 

Lemma 4.2. For any a > 0, there exists M\ a > such that for any 6 e 1, 
5 G (0, 1), and £ G dQ, there exists a function C^'l G C 1 (M n ) such that 

\b + a(p + Cij(-p)n(0))\ < m a (5), 

\DCif(p)\ < M la 

for any p G M. n , where m a is a modulus. 

Now we are in position to build the test-functions we need. We are going 
to do it locally, i.e. in a neighborhood of a point £ G dVL and we set p§(x) := 
n(£) • x. 

Lemma 4.3. For fixed constants a, b G M, we denote by Cff , m a , and Mi a 
i/ie functions and the constant given in Lemma 4.2 /or 5 G (0, 1) and £ G dQ. 
We introduce the function x defined, for Z G W 1 , by 

x(z) ■= -ci] b {^)pdz) + — - 2 — 

for e G (0, 1) and A > 0. If A > max{Mf aJ (M la M B )/26} =: M 2a , then 
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(i) X (Z) > -^L _ Mxa \Z\ for all Z e W 1 , 

(ii) For all R> there exists a modulus m = m^ a such that if\x — y\/e 2 < R, 
then 

b + B(x, —aDx(x — y)) < m(5 + e + \x — £| + \y — £|) , 
if x E dQ, )/eO and 

6 + -a£>x(z - y)) > -m(S + e+\x-£\ + \y- f |) , 
for i6(l,!/6 <9f2. 

Proo/. We first prove (i). Note that c£'J(p) < c£'J(0) + M Xa |p| for all pei" 
by Lemma 4.2. Thus, 

^)>|^-M 1o (I|1 + 1) W Z)| + ^MS£ 



\2 



>\^-M la \Z\ + (P^(A-Ml 



As 2 ±U| 1 e 



>^L-M la |Z| 



12 

for all Z e M n . We have used Young's inequality in the second inequality 
above. 

We next prove (ii). We have for any x e dfl 

-aD X (x - v) = + C$(^-)n(cj) 

+ a (sW^M) (JC W(£^>) - 2Af !(f )). 

We divide into two cases: (a) p§(a;) — p^(y) < 0; (b) pz(x) — p%(y) > 0. 

We first consider Case (a). Using (AO) and a Taylor expansion at the point 
(x + y)/2, it is easy to see that 

< p(x) — p(y) = n((x + y)/2) ■ (x — y) + o(\x — y\) for x e dVL. 

Using the continuity of Dp, and therefore of n, we see that 

=n{{x + y)/2) ■(x-y) + (n(f ) - n((z + y)/2)) • {x - y) 
>o(\x - y\) - m(\x -£\ + \y- £\)\x - y\ . 

for some modulus m. Therefore, taking into account the restriction \x—y\/e 2 < 
R and changing perhaps the modulus m, we have 

ftW-ftM >_ ro(8 + |j _ {| + | {|) 

and this yields 

^M_^M^ and - " ^ {DC%{^-) - 2Ah{£)) -> 
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as e — > 0, x — > £, and y — > £, which implies that 

b + B{x, -aD X (x -y))<b + B(x,a(^ + C*J (^)n(£)) ) 



M 



B 



>W-ftW) (Jc e;(£z»)-M«({))) 



e 2 v ^ 



In Case (b) by (A3), (A4) and Lemma 4.2, we get (changing perhaps the 
modulus m) 

b + B(x, -aDx(x - y)) 

< b + B( X ,a(y^ + c£f(^)nfc))) + fl M^0) (M B |IX^l - 2^) 

< 6 + + cjf(^)n(£)) ) + m(|* - £|) 
<m(<5+ |z-£|), 

since A > (M la M^)/2^. Gathering the two cases, we have the result. Similarly 
we obtain b + B(y, —aDx{x — y)) > — m(5 + e + \x — £| + |y — £|) if y G <9f2. □ 

4.2. Comparison Results for (CN) and (DBC). 

Proof of Theorem 1.1. We argue by contradiction assuming that there would 
exist T > such that maxg T (n — u)(a;, i) > 0, where Qt := fi x (0,T). 
Let w 7 denote the function 

m 7 (x, t):= max {w(x, s) — (l/j)(t — s) 2 } , 

sG[0,T+2] 

for any 7 > 0. This sup-convolution procedure is standard in the theory of 
viscosity solutions (although, here, it acts only on the time-variable) and it is 
known that, for 7 small enough, u 1 is a subsolution of (CN) in Q x (a 7 , T + 1). 
where a 7 := (27maxg T+2 \u(x, £)|) ( see [2, 9] for instance). 

Moreover, it is easy to check that \uj\ < M 7 in Q x (a 7 , T + 1) and therefore 
by the coercivity of H and the C 1 -regularity of dfl we have, for all x,y £ Q, 
t,s G [cLf, T + 1] 

\u l {x 1 t)-v?(y,s)\ < M 1 {\x-y\ + \t - s\) (4.1) 

for some M 7 > 0. Finally, as 7 — > 0, maxg (w 7 — f)(x, i) — >■ maxg (u — 
w)(x,t) > 0. 

Therefore it is enough to consider maXg r (M 7 — v)(x, t) for 7 > small 
enough, and we follow the classical proof by introducing 

max{(a 7 — v)(x,t) — rjt}, 

Qt 

for < 77 <C 1. This maximum is achieved at (£, r) G fix [0,T], namely 
(w 7 — v )(£, t) — r]t = maxg T {(M 7 — v)(x, t) — rjt}. Clearly r depends on rj but 
we can assume that it remains bounded away from 0, otherwise we easily get 
a contradiction. 
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We only consider the case where £ G dQ. We first consider problem (CN). 
We introduce the function xi defined by : Xi(Z) := x{~ Z) where % is the 
function given by Lemma 4.3 with a = 1 and 6 = 0. It is worth pointing out 
that, compared to the proof of Lemma 2.2, the change Z — > —Z, consists in 
exchanging the role of x and y, which is natural since the variable x is used 
here for the subsolution while it was corresponding to a supersolution in the 
proof of Lemma 2.2. 

We define the function : if x [0, T] ->■ R by 

y, t) := m 7 (x, t) - v(y, t) - rjt - Xi(x - y) - a(p(x) + p(y)) 

-\x-tf-{t-T)\ 

_ 2 

Let achieve its maximum at (x, y, t) G fl x [0, Tj. By standard arguments, 
we have 

x, y — > £ and t — > r as e — > (4.2) 

by taking a subsequence if necessary. In view of the Lipschitz continuity (4.1) 
of u 7 , we have 

|p| < M 7 , (4.3) 

where p := (x — y)/s 2 . 

Taking (formally) the derivative of with respect to each variable x, y at 
(x, y, t), we have 

D x u<(x,t) = D x xi(x-y) + 2(x-£) + ah(x), 
D y v(y,t) = D y xi(x-y) - an(y). 

We remark that we should interpret D x if and D y v in the viscosity solution 
sense here. We also point out that the viscosity inequalities we are going to 
write down below, hold up to time T, in the spirit of [2], Lemma 2.8, p. 41. 
By Lemma 4.3 we obtain 

B(x,D x u(x,t)) > -m(5 + e+ \x-£\ + \y-£\) + 6a > 0, 
B(y, D y v(y,t)) < m{5 + e + \x - f | + \y - ^|) - 9a < 

for e, 5 > which are small enough compared to a > 0, where m is a modulus. 

Therefore, by the definition of viscosity solutions of (CN), using the argu- 
ments of User's guide to viscosity solutions [9], there exists ai,a 2 G M such 
that 

ai + H(x,D x v?(x,t)) < 0, 
a 2 + H(y,D y v{y,t)) >0 

with ax — a 2 = rj + 2(t — r). By (4.3) we may assume that p — > p as e — > for 
some p G M. n by taking a subsequence if necessary. Sending e — > and then 
a — > in the above inequalities, we have a contradiction since a\ — a 2 — > rj > 
while the i?-terms converge to the same limit. Therefore r cannot be assumed 
to remain bounded away from and the conclusion follows. 
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We next consider problem (DBC). Let (£, r) be defined as above and let C^ ,s 
be the function given by Lemma 4.1. We define the function \i '■ ^ x M — ?■ IR 
by 

X2(x-y,t- s) :~ (\x - y\ 2 + (t - s) 2 ) + ^) (p(x) - p{y)) 

A{p{x) - p(y)) 2 
e 2 

for A > M\. We define the function ^ : if x [0, T] R by 

* 2 (a?, V, t, s) : = u 7 (x, t) - v(y, s)-rjt- X2(x -y,t- s) + a(p(x) + p(y)) 

-ix-er-(t-r) 2 . 

Let ^2 achieve its maximum at (x,y,t,s) G f2 x [0,T] 2 and set 

_ x — y _ t — ~s 

Derivating (formally) ^2 with respect to each variable t, s at (x,y,t,s), we 
have 

Tlfta?, i) = V + q + q) ■ (P®-P®\ 



v 



: (y,s)=q + D q C^(p,q) 



{p{x) - p(y)) 



S 2 



We remark that we should interpret uj and v s in the viscosity solution sense 
here. 

We consider the case where x G dVL. Note that D q C^' s (p,q) < and then 
we have 

u] (x, t ) + B (x, D x u (x , t) ) 

= r) - D q C^ 5 (p, q)-^- + q + B(x, D x u{x, t)) 
> - m{8 + e + \x - f | + \y - f |) + 9a > 

for e, 5 > which are small enough compared to a > 0. In the case where 
y G <9f2 we similarly obtain 

v t (y, s) + B(y, D y v{y)) < m(5 + e) - 9a < 

for e, 5 > which are small enough compared to a > 0. 

The rest of the argument is similar to that given above and therefore we 
omit the details here. □ 

4.3. Existence and Regularity of Solutions of (CN) and (DBC). 

Proof of Theorem 1.2. The existence part being standard by using the Perron's 
method (see [19]) , we mainly concentrate on the regularity of solutions when 
Mo G W 1,OQ (Q). We may choose a sequence {"UolfceN C C 1 (f2) so that \\uq — 
wo||z,°°(n) < an d ll-D^olloo < C for some C > which is uniform for all 
k G N. We fix k G N. 
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We claim that u k _(x,t) := —M\t + u k (x) and u^_(x,t) := M\t + u k {x) are, 
respectively, a sub and supersolution of (CN) or (DBC) with uq = Uq for a 
suitable large Mi > 0. We can easily see that vl± are a sub and supersolution 
of (CN) or (DBC) in Q if Mi > max{|5(x,p)| : x G 5(0,(7)}. 

We recall (see [25, 9] for instance) that if x G dQ, then 

(x, t) = {(£>«o0) + An(x), -Mi) : A < 0}, 

where D + u k _(x,t) denotes the super-differential of u_ at (x,t). We need to 
show that 

min{-Mi + H(x, Du k (x) + \n{x)), B(x, Du k (x) + Xn{x))} < 

for all A < 0. By (A2) it is clear enough that there exists A < such that, if 
A < A, then B(x, Duq(x) + \n(x)) < 0. Then choosing Mi > max{H(x,p + 
Xn(x)) : x G dQ, p G 5(0, C), A < A < 0}, the above inequality holds. 
A similar argument shows that u k + is a supersolution of (CN) for Mi large 
enough. It is worth pointing out that such Mi is independent of k. We can 
easily check that u± are a sub and supersolution of (DBC) on dQ x (0, oo) too. 

By Perron's method (see [19]) and Theorem 1.1, we obtain continuous solu- 
tions of (CN) or (DBC) with uq = Uq that we denote by u k . As a consequence 
of Perron's method, we have 

-Mi* + u k {x) < u k (x, t) < M x t + u k {x) on Q x [0, oo). 

To conclude, we use a standard argument: comparing the solutions u k (x,t) 
and u k (x,t + h) for some h > and using the above property on the u k , we 
have 

\\u k (-, - + h)- u k (-, OIL < \\u k (; h) - u k (-, 0)11^ < M 1 h . 

As a consequence we have || (it fc )t||oo < Mi and, by using the equation together 
with (Al), we obtain that Du k is also bounded. Finally sending k — > oo by 
taking a subsequence if necessary we obtain the Lipschitz continuous solution 
of (CN) or (DBC). 

We finally remark that, if uq G C(Q), we can obtain the existence of the 
uniformly continuous solution on Q x [0, oo) by using the above result for 
Mo G W 1,0O (Q) and (1.1) which is a direct consequence of Theorem 1.1. □ 

4.4. Additive Eigenvalue Problems. 

Proof of Theorem 1.3. We first prove (i). For any e G (0, 1) we consider 

eu e + H(x, Du £ ) = in Q, 

(4.4) 

B(x,Du £ )=0 ondQ. y 1 

Following similar arguments as in the proof of Theorem 1.2, it is easy to prove 
that, for C > large enough —C/e and C/e are, respectively, a subsolution 
and a supersolution of (4.4) or (4.6). 

We remark that, because of (Al) and the regularity of the boundary of Q, the 
subsolutions w of (4.4) such that —C/e < w < C/e on Q satisfy \Dw\ < M 2 
in Q for some M 2 > and therefore they are equi-Lipschitz continuous on 



LARGE TIME BEHAVIOR FOR H-J EQUATIONS WITH NONLINEAR BC 



41 



f2. With these informations, Perron's method provides us with a solution 
u £ G W 1,co {Vi) of (4.4). Moreover, by construction, we have 

\eu £ \ < Mi on tt and \Du £ \ < M 2 in Q. (4.5) 

Next we set v £ (x) := u £ (x) — u £ (xo) for a fixed xq G fi. Because of (4.5) and 
the regularity of the boundary dfl, {-u £ } ee (o,i) is a sequence of equi-Lipschitz 
continuous and uniformly bounded functions on Q. By Ascoli-Arzela's Theo- 
rem, there exist subsequences {v £] }j and {u £j }j such that 

v Ej —> v, SjU £j — > —c uniformly on Q 

as j — > oo for some v G W 1,00 (Q) and cGl. By a standard stability result of 
viscosity solutions we see that (v,c) is a solution of (El). 
In order to prove (ii) we just need to consider 

eu £ + H(x, Du £ ) = in Q, 

(4.6) 

eu £ + B(x, Du £ ) = onffi y ' 

instead of (4.4). By the same argument above we obtain a solution of (E2). □ 
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